-- Logs begin at Tue 2021-11-23 11:56:55 UTC, end at Tue 2021-11-23 13:54:02 UTC. -- Nov 23 12:40:32.944180 dv-cinder-818886-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 23 12:40:32.954393 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 12:40:32 2021] *** Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: nodename: dv-cinder-818886-1-iscsi Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: machine: x86_64 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: clock source: unix Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: pcre jit disabled Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: detected number of CPU cores: 4 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: current working directory: / Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: detected binary path: /usr/bin/uwsgi-core Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: your processes number limit is 47680 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: your memory page size is 4096 bytes Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: detected max file descriptor number: 2048 Nov 23 12:40:32.957361 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: lock engine: pthread robust mutexes Nov 23 12:40:32.958201 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: thunder lock: enabled Nov 23 12:40:32.958201 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 23 12:40:32.958201 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 12:40:32.998206 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: Python main interpreter initialized at 0x5574d2c769c0 Nov 23 12:40:32.998206 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: python threads support enabled Nov 23 12:40:32.998206 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: your server socket listen backlog is limited to 100 connections Nov 23 12:40:32.998206 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: your mercy for graceful operations on workers is 90 seconds Nov 23 12:40:32.998694 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 12:40:32.998694 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: *** Operational MODE: preforking *** Nov 23 12:40:32.999029 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: *** uWSGI is running in multiple interpreter mode *** Nov 23 12:40:32.999029 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: spawned uWSGI master process (pid: 66591) Nov 23 12:40:32.999250 dv-cinder-818886-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 23 12:40:33.000495 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: spawned uWSGI worker 1 (pid: 66603, cores: 1) Nov 23 12:40:33.000495 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: spawned uWSGI worker 2 (pid: 66604, cores: 1) Nov 23 12:40:33.000495 dv-cinder-818886-1-iscsi devstack@keystone.service[66591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 12:40:37.854254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:40:37.854254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: from cryptography.utils import int_from_bytes Nov 23 12:40:37.855075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:40:37.855075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: from cryptography.utils import int_from_bytes Nov 23 12:40:37.855483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:40:37.855483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: from cryptography.utils import int_from_bytes Nov 23 12:40:37.855588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:40:37.855588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: from cryptography.utils import int_from_bytes Nov 23 12:40:37.903969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:40:37.904182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:40:37.904299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:40:37.904383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:40:37.904447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] command line args: [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:40:37.904514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] command line args: [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:40:37.904577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:40:37.904638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:40:37.904900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ================================================================================ {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:40:37.905033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ================================================================================ {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:40:37.905154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] admin_token = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] admin_token = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] config_dir = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] config_dir = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] config_source = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] debug = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.905872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] config_source = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.906000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.907878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] debug = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.907878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.908935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_config_append = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_config_append = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_dir = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_dir = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_file = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_file = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.909957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.910934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.911940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.912929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] publish_errors = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] publish_errors = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.913935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] standard_threads = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] standard_threads = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] use_journal = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] use_journal = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] use_json = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] use_json = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] use_stderr = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.914952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] use_stderr = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.915031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] use_syslog = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.915106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] use_syslog = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.915181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.915250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:40:37.915318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.915876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.916837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.917954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.918939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.919897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.920788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.921925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.922989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.923891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.924973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.925993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.926911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.927907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.928937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.929930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.930957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.931969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.932918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.933977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.934976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.external = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.external = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.935879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.password = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.936966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] auth.token = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.password = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] auth.token = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.937982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.938923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.939929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.940895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.941921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.942941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.943970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.944959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.945983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.946971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.947886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.948940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.949968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.950885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.951960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.952902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.953914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.954933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.955955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.956895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.957915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.958934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.959938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.960932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.961938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.962973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.963974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.964925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.965956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.966961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.967891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] role.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.968997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] role.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] role.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] role.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.969973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.970902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.971909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.972974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.973905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.974907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.975918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.976956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.977969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.978982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.979893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.980979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.connection = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.connection = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.981969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.982898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.983920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.984846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:40:37.985820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:40:37.985820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:40:38.013268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.013490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.013715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.013826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.014000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.014234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.023370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.023660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.055007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.055322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.055490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.055577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.109395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.109773 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.161861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.162199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.162507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.162719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.315485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.315820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.315966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.316065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.316303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.316510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.319259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.319473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.319671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.319916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.320110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.320297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.340954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.341654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.353253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.353690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.366513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.366669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.366882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.367871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.368106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.368374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 12:40:38.385115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.385321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 12:40:38.385488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.385614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.385747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 12:40:38.385826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 12:40:38.385990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 12:40:38.386340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.386980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.387227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.397158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.397425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.397606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.397705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.397896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.398020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.398131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.398433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.406031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.406889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.409550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.409822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.410177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.410951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.411876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.412000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.412094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.412171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.412405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.412661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.439890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.440093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.441449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.441576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.441834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.441925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.446854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.446997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.447135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.447215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.447363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.447451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.454671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.454802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.454940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.455128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.459177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.459323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.459454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.459538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.459717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.459842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.459965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.460847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.461089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.461182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.479495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.479675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.479817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.479899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.484226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.484507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.487830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.488101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.488258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.488390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.493002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.493220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.496453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.496663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.500036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.500322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.500453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.500572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.500700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.500874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.501862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.520865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.521037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.521111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.521242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.521371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.521449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.521615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.521706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.529204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.529329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.530976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.531563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.532018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.532327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.534474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.534747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.535014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.535270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.535365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.535549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.535638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.535825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.536124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.536435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.548877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.549155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.549434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.549560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.549664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.549745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.549969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.550808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.551075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.567748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.568439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.570988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.571655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.574229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.574910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.575738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.576448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.577413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.577688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.577967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.578199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.578476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.578742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.585012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.585860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.586552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.587396 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.589635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.589912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.590254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.590438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.590529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.590744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.591024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.591297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.599703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.600002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.600415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.600512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.600766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.601052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.608280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.608572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.608939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.609168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 12:40:38.609262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.609473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.609560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.609741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.609828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.610878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.611903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.612097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.612382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.612642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 12:40:38.649983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574d2c769c0 pid: 66603 (default app) Nov 23 12:40:38.650262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5574d2c769c0 pid: 66604 (default app) Nov 23 12:40:38.654385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81267c2-a56b-4e01-beab-648884070522 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:38.654669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81267c2-a56b-4e01-beab-648884070522 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:38.655043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81267c2-a56b-4e01-beab-648884070522 None None] PATH_INFO: `/v3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:38.659861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Tue Nov 23 12:40:38 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:46.034398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:46.035059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:46.035059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:46.040007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:46 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:40:46.045879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:46.046338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:46.046419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:46.087611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG oslo_db.sqlalchemy.engines [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:40:46.235058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG passlib.handlers.bcrypt [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66603) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 12:40:46.235474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG passlib.handlers.bcrypt [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66603) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 12:40:46.296506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:46.298381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:46.444342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:40:46.619988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:46.666807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG oslo_db.sqlalchemy.engines [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:40:46.763955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc8df3-bd07-4c9d-8daa-dc0ea5ab4c8b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:46.769431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:46.770062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:46.770350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:46.770627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:46.779880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:46.831855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.common.rbac_enforcer.enforcer [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 12:40:46.832265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187602f4-a2bb-4a78-80d5-7152165e4120 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:46.842847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:40:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:40:46.849164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:46.861087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526793b-a0a6-4acf-8909-5ead524be4e8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:46.866816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:46.867973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:46.868274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:46.868577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:46.870079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8d73aaed4704c2faee627a52d37a0f8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:46.922328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 12:40:46.922671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e2947-4d3d-4f6f-9b88-d338bb340fa1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:46.927376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:40:46 2021] GET /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:48.988354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f7c1-6cdd-443b-911b-629ff92ecab5 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:48.988931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f7c1-6cdd-443b-911b-629ff92ecab5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:48.988931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f7c1-6cdd-443b-911b-629ff92ecab5 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:48.993326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:40:48.999385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:48.999830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:49.000045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:49.024719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:49.026288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:49.035522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:40:49.058323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f7c1-6cdd-443b-911b-629ff92ecab5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:49.072431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f7c1-6cdd-443b-911b-629ff92ecab5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:49.077564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:49.078171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:49.078463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:49.078750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:49.086986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:49.088788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27657-79a3-438d-8068-002bcc47e256 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:49.097906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:40:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:40:49.103966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:49.113514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07457ff0-8330-4bbc-aade-cca310977fc0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:49.119013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:49.119831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:49.120117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:49.120443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:49.121863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:49.124064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69153-1d25-44d9-b2e7-cab8acb01e0f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:49.125607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:40:49 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:51.315331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ccc9e-8325-477f-99bf-84330e3f481b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.315896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ccc9e-8325-477f-99bf-84330e3f481b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.315896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ccc9e-8325-477f-99bf-84330e3f481b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.317590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:40:51.323052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.323523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.323638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.346902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:51.348052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:51.355602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:40:51.378823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ccc9e-8325-477f-99bf-84330e3f481b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:51.391992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ccc9e-8325-477f-99bf-84330e3f481b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:51.396617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:51.397339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.397625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.397909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.413001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:40:51.419786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:40:51.421367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 6/12] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:40:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:40:51.427868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:51.437021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9d5a-02dc-4368-b905-d203bf79de37 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:51.442592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:51.443195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.443482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.443759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.444531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:40:51.444826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:51.446593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:40:51.446593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:40:51.446593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:40:51.447495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:51.459210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 7/13] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:40:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:51.464979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:51.474871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d771-016c-40b5-810f-e2c459171b31 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:51.480104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:51.480965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.481251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.481535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.483311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:51.485238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:51.486746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:40:51 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:51.492629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:51.502849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0b67-4245-4676-b903-2a519b25ff5c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:51.507623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:51.508382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.508672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.508995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.510133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:51.511923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdb78a-bb2d-4b69-8f16-c5dd11abde21 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:51.513469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:40:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:51.519677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:51.530045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491f0f-98a6-4cf6-a7a5-877fa67cd3be admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:51.535096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:51.535673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:51.535955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:51.536214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:51.537053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.domain.id=default, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:40:51.537349 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:51.539147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:40:51.539147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:40:51.539147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:40:51.540368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82450b-a1fb-4f54-9a0d-65e30283e234 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:51.548495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 8/16] 10.222.0.60 () {56 vars in 1343 bytes} [Tue Nov 23 12:40:51 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.domain.id=default&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:53.621832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d9f-aad7-4d40-abab-514b88adfa4b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.622393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d9f-aad7-4d40-abab-514b88adfa4b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.622393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d9f-aad7-4d40-abab-514b88adfa4b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.624755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 9/17] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:40:53.630667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.631104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.631204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.665007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG passlib.handlers.bcrypt [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66604) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 12:40:53.665425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG passlib.handlers.bcrypt [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66604) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 12:40:53.711257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:53.712856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:53.750293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 9/18] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:40:53.772533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e139d9f-aad7-4d40-abab-514b88adfa4b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:53.786774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e139d9f-aad7-4d40-abab-514b88adfa4b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:53.791732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:53.792484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.792770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.793050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.806236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:40:53.812746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:40:53.813916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:40:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:40:53.820145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:53.829742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ae4f-e6ac-4d71-b854-9c4a0fcb2e23 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:53.835280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:53.836646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.836646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.836794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.837617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:40:53.837915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:53.838967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:40:53.838967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:40:53.838967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:40:53.839893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:53.850291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:40:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:53.856335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:53.866879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d3682-d780-4dfc-bc24-3b727c9a6b66 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:53.871642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:53.872540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.872777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.873058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.874393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:53.876303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:53.877805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:40:53 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:53.883425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:53.893003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c1f5c-a55d-4140-8170-a2d96ee09042 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:53.897332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:53.898074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.898356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.898635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.899922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:53.901664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148035e1-1728-45e5-9aff-3185e4b6cfeb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:53.903095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 11/22] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:40:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:53.909041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:53.918376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10659eb-0c13-47ea-b377-91791bfc9531 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:53.922865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:53.923739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:53.924019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:53.924347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] PATH_INFO: `/v3/domains/default/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:53.926299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3fde6f358f0c4f9d97186836d44cc1d3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:53.927278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:40:53.927278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:40:53.927278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:40:53.929298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad411a-c715-4a60-b3ff-188a4129ce29 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:54.127491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1382 bytes} [Tue Nov 23 12:40:53 2021] PUT /identity/v3/domains/default/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:40:56.212095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54730-3f20-4e2e-9c52-697e41adc204 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.212654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54730-3f20-4e2e-9c52-697e41adc204 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.212654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54730-3f20-4e2e-9c52-697e41adc204 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.214307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:40:56.220390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.220820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.220943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.245969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:56.247491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:56.315494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:40:56.338849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54730-3f20-4e2e-9c52-697e41adc204 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:56.352866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54730-3f20-4e2e-9c52-697e41adc204 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:56.358515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:56.359264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.359550 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.359834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.372709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:40:56.379062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:40:56.380178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 13/26] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:40:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:40:56.386344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:56.395929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b250-3bea-4b1d-b755-8fb273f83f16 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:56.401379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:56.401975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.402259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.402535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.403246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:40:56.403545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:56.407002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:56.425158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 14/27] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:40:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:56.431050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:56.441461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28e59-307d-41d4-a9e4-683bfb8f592d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:56.448650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:56.449449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.449728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.450003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.451460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:56.457847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:56.459418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 14/28] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:40:56 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:56.465231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:56.475445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d842-c727-4d6c-bbff-a1e04022fe65 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:56.480866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:56.481595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.481883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.482169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.483434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:56.485178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80f12-c4cb-4681-8f61-bdd076b99e78 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:56.486759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 15/29] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:40:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:56.492836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:56.503096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b936-2a5e-4905-aee8-374f1f00a40d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:56.507578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:56.508162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:56.508483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:56.508764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:56.509552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.domain.id=default, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:40:56.509853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:56.511725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e69e-50dc-4b42-9171-e4eab76a0b99 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:56.519848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 15/30] 10.222.0.60 () {56 vars in 1343 bytes} [Tue Nov 23 12:40:56 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.domain.id=default&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 530 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:40:58.614161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e75d-a3f7-4321-a067-ce66b95245b8 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:58.614745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e75d-a3f7-4321-a067-ce66b95245b8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:58.614745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e75d-a3f7-4321-a067-ce66b95245b8 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:58.616665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 16/31] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:40:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:40:58.621916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168005-f510-470f-9313-b8132e1e663a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:58.622366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168005-f510-470f-9313-b8132e1e663a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:58.622457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168005-f510-470f-9313-b8132e1e663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:58.645316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b0168005-f510-470f-9313-b8132e1e663a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:40:58.646504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b0168005-f510-470f-9313-b8132e1e663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:40:58.654241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:40:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:40:58.676745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e75d-a3f7-4321-a067-ce66b95245b8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:58.690219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e75d-a3f7-4321-a067-ce66b95245b8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:58.694727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:58.695306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:58.695598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:58.696132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:58.704785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:58.706569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06651-6626-4c68-b920-4a5f56b9fb63 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:58.715377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 17/33] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:40:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:40:58.721633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0168005-f510-470f-9313-b8132e1e663a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:40:58.730728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0168005-f510-470f-9313-b8132e1e663a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:40:58.736342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:40:58.737136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:40:58.737423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:40:58.737705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:40:58.738997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:40:58.740799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8319a-f6dc-4e9d-a2a4-8669b0207c5f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:40:58.742294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 17/34] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:40:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:00.930918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652f5b-074e-4d3d-bd37-3f4beed75c17 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:00.931460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652f5b-074e-4d3d-bd37-3f4beed75c17 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:00.931460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652f5b-074e-4d3d-bd37-3f4beed75c17 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:00.933203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 18/35] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:00.938780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:00.939220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:00.939303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:00.962411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:00.963579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:00.971324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 18/36] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:00.994863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652f5b-074e-4d3d-bd37-3f4beed75c17 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:01.010303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652f5b-074e-4d3d-bd37-3f4beed75c17 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:01.014828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:01.015558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:01.015849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:01.016135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:01.028336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:01.030489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:01.048573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:41:01.049726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 19/37] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:01.056102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:01.065508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f9189-8906-49f4-bd8b-c7a763c971a3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:01.080008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:01.080677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:01.080965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:01.081246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:01.081977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:01.082270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:01.083332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:01.083332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:41:01.083332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:41:01.084308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba10d7c-a345-416a-9ef7-0d2c609b9c62 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:01.102055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 19/38] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:41:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:01.108176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:01.118630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d67cab-be72-449d-b39b-778dac901082 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:01.124466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:01.125089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:01.125368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:01.125648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:01.126326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:01.127376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:01.127376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:41:01.127376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:41:01.128638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317ebe4-74b7-4b11-bb34-7f9051bb8980 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:01.161478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:41:01 2021] POST /identity/v3/projects => generated 301 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:03.366185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a0ef-d93b-4622-ae27-1ed4fee0adcc None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:03.366748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a0ef-d93b-4622-ae27-1ed4fee0adcc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:03.366748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a0ef-d93b-4622-ae27-1ed4fee0adcc None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:03.368429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:03.374207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091570-a86b-4167-9deb-5d22f06f68d2 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:03.374679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091570-a86b-4167-9deb-5d22f06f68d2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:03.374761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091570-a86b-4167-9deb-5d22f06f68d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:03.398568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0c091570-a86b-4167-9deb-5d22f06f68d2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:03.399737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0c091570-a86b-4167-9deb-5d22f06f68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:03.470352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:03.493005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a0ef-d93b-4622-ae27-1ed4fee0adcc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:03.506434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a0ef-d93b-4622-ae27-1ed4fee0adcc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:03.511186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:03.511773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:03.512054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:03.512363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:03.513079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:03.514282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:03.514282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:41:03.514282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:41:03.515305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8de3c3-74c1-4274-9631-5c5d8a04ea0a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:03.722284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 21/42] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:41:03 2021] POST /identity/v3/roles => generated 219 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:05.918576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5168f-22b8-4f29-8cd7-1ffe38d5ba52 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:05.919155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5168f-22b8-4f29-8cd7-1ffe38d5ba52 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:05.919155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5168f-22b8-4f29-8cd7-1ffe38d5ba52 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:05.922014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 22/43] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:05.927757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197b48-f91d-4e15-b81f-476668708f51 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:05.928175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197b48-f91d-4e15-b81f-476668708f51 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:05.928336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197b48-f91d-4e15-b81f-476668708f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:05.953491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-10197b48-f91d-4e15-b81f-476668708f51 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:05.954983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-10197b48-f91d-4e15-b81f-476668708f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:05.964469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 22/44] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:05.988649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5168f-22b8-4f29-8cd7-1ffe38d5ba52 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:06.003271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5168f-22b8-4f29-8cd7-1ffe38d5ba52 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:06.008153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:06.008799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:06.009086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:06.009377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:06.010103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:06.011095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:06.011095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:41:06.011095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:41:06.012011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a59119-bc12-4ee1-a8dd-1771ac3818e4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:06.027820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:41:05 2021] POST /identity/v3/roles => generated 225 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:08.237831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3bad-4dc0-4dc5-9f05-b556dcc2bb2c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:08.238415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3bad-4dc0-4dc5-9f05-b556dcc2bb2c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:08.238415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3bad-4dc0-4dc5-9f05-b556dcc2bb2c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:08.239997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 23/46] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:08.245538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267664fa-8ecb-48e6-9b04-58f70b810823 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:08.246028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267664fa-8ecb-48e6-9b04-58f70b810823 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:08.246130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267664fa-8ecb-48e6-9b04-58f70b810823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:08.269928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-267664fa-8ecb-48e6-9b04-58f70b810823 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:08.271124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-267664fa-8ecb-48e6-9b04-58f70b810823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:08.279010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 24/47] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:08.302864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe3bad-4dc0-4dc5-9f05-b556dcc2bb2c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:08.317646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe3bad-4dc0-4dc5-9f05-b556dcc2bb2c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:08.322697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:08.323300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:08.323597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:08.323877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:08.324634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:08.326575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84e03-34f2-4117-bc36-2720c614159e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:08.343957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 24/48] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:41:08 2021] POST /identity/v3/roles => generated 223 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:10.594861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4760-a5c5-490d-bc46-c7fc5f2bb658 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:10.595452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4760-a5c5-490d-bc46-c7fc5f2bb658 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:10.595452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4760-a5c5-490d-bc46-c7fc5f2bb658 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:10.597191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 25/49] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:10.602977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:10.603496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:10.603601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:10.627478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:10.628723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:10.636208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 25/50] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:10.660706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b4760-a5c5-490d-bc46-c7fc5f2bb658 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:10.674128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b4760-a5c5-490d-bc46-c7fc5f2bb658 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:10.678756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:10.679466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:10.679776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:10.680058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:10.681246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:10.683002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6dea1-cc78-4835-b7e9-25f9a17d8a85 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:10.684609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:10.690712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:10.700059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e03018-260f-40d6-98ed-e4c6e89e0016 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:10.706784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:10.707584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:10.708204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:10.708630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:10.709642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:10.711440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:10.711440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:41:10.711440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:41:10.713158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebeec-6c15-44b9-8fc8-77dd214a97a8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:10.760419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 26/52] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:41:10 2021] POST /identity/v3/projects => generated 312 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:12.927140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771074-24cd-4883-b8e7-2031d1afe82d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:12.927679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771074-24cd-4883-b8e7-2031d1afe82d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:12.927679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59771074-24cd-4883-b8e7-2031d1afe82d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:12.929413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 27/53] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:12.935248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:12.935723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:12.936095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:12.959394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:12.960611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:13.036436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 27/54] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:13.059677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59771074-24cd-4883-b8e7-2031d1afe82d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:13.073630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59771074-24cd-4883-b8e7-2031d1afe82d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:13.078455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:13.079193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:13.079479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:13.079757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:13.080913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:13.082646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb9691-ecaf-421f-8d87-41f70a9ed09d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:13.084143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:41:13.090400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:13.101557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e30f-f2ac-4066-b092-632f7d5524cd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:13.105992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:13.106613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:13.106903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:13.107188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:13.107901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:13.109948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d97b5-015e-4357-b2d4-846218703882 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:13.140943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 28/56] 10.222.0.60 () {60 vars in 1161 bytes} [Tue Nov 23 12:41:13 2021] POST /identity/v3/projects => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:15.259524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aba95-c118-4401-8849-1f9179546f65 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:15.260031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aba95-c118-4401-8849-1f9179546f65 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:15.260031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aba95-c118-4401-8849-1f9179546f65 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:15.261794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 29/57] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:15.267588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:15.268045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:15.268158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:15.293062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:15.294304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:15.364506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 29/58] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:15.388535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aba95-c118-4401-8849-1f9179546f65 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:15.402623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aba95-c118-4401-8849-1f9179546f65 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:15.407807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:15.408573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:15.408862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:15.409152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:15.410281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:15.412047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5290e8-d37e-4bd9-9c12-23744de4bf0d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:15.413597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 30/59] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:15.419400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:15.429464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763677-8ab6-4e56-9c29-32c9dffbff64 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:15.434913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:15.435651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:15.435942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:15.436227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:15.437121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:15.438164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:15.438164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:41:15.438164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:41:15.439421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802eaee-28d4-40fb-be2b-51e38ca5e121 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:15.465411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 30/60] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:41:15 2021] POST /identity/v3/users => generated 275 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:18.137448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0e05-0971-4693-96d1-b56dbce3810d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.137987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0e05-0971-4693-96d1-b56dbce3810d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.137987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0e05-0971-4693-96d1-b56dbce3810d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.139704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 31/61] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:18.145221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.145629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.145785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.170376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:18.171611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:18.178958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 31/62] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:41:18.202457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e0e05-0971-4693-96d1-b56dbce3810d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.219317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e0e05-0971-4693-96d1-b56dbce3810d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.224489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.225241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.225528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.225815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.237644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:18.243925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:18.245033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 32/63] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:18.251103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.260307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61ec5-2272-4d31-951f-4e591056b704 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.266254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.266862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.267149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.267427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.268146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:18.268484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:18.270119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:18.279410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 32/64] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:18.285443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.295810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27b04-97ac-41e9-907f-4682f111891c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.301504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.302369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.302660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.302940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.322781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:18.325062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:18.326578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 33/65] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:18.332267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.342453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada437d-d8f4-49be-9428-8e06f35d2cf9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.348114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.348728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.349012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.349289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.358035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:18.359846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:18.369056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 33/66] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:18.375020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.384985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501c92-8b76-478a-a489-4ba3158455bf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.390819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.391607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.391900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.392182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.393520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:18.395660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3dd1-47c6-4e92-b7ca-0aa0e9efcbb8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:18.397269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 34/67] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:18.403419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:18.413956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e480e-e0d1-48d7-8810-d3186ef4fddc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:18.422555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:18.423434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:18.423734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:18.424018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:18.424859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:18.425162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:18.427043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6aa35-8fcc-4384-b5fa-c38d54e068bf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:18.433076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 34/68] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:18 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:20.484585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5864-4867-4d26-a65a-4e6e2c524d56 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.485186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5864-4867-4d26-a65a-4e6e2c524d56 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.485186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5864-4867-4d26-a65a-4e6e2c524d56 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.486822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 35/69] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:20.492414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.492805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.492980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.516557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:20.517728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:20.526024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 35/70] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:20.549350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5864-4867-4d26-a65a-4e6e2c524d56 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:20.562321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5864-4867-4d26-a65a-4e6e2c524d56 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:20.566764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:20.567489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.567775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.568050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.580280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:20.586506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:20.587614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 36/71] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:20.593752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:20.602838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59ca93-69cd-4519-831f-cccdc0e7e3c0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:20.608581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:20.609196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.609489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.609792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.610540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:20.610820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:20.612526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:20.622134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 36/72] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:20.628383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:20.640533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e477e5-2c04-48d4-9b9e-59842deaa4d4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:20.647027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:20.647833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.648121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.648431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.649737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:20.652030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:20.653690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:20 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:20.664358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:20.675012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f1d7c-ad41-463f-ab5f-865d47de8855 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:20.680647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:20.681436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.681718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.681995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.683243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:20.685427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf3cdc-a059-4f2b-a14a-58a6a4ab4cdd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:20.686995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:20 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:20.692935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:20.703016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee3869-21fe-4a65-9824-0c80839de677 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:20.708049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:20.708917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:20.709201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:20.709482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70/users/4b441378e641415e97cd2c14dde4afda/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:20.711459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724025c1e3724b58b72260918cc31b70, user_id=4b441378e641415e97cd2c14dde4afda, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:20.714247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4052c-ac34-4858-9fc1-11169fcd43d5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:20.728305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:41:20 2021] PUT /identity/v3/projects/724025c1e3724b58b72260918cc31b70/users/4b441378e641415e97cd2c14dde4afda/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:41:22.803833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7685c6-b4ab-4126-9347-8724b9458ee2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:22.804438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7685c6-b4ab-4126-9347-8724b9458ee2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:22.804438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7685c6-b4ab-4126-9347-8724b9458ee2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:22.806101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 38/76] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:22.811718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:22.812157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:22.812308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:22.835551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:22.836794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:22.909705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:22.933544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7685c6-b4ab-4126-9347-8724b9458ee2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:22.951941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7685c6-b4ab-4126-9347-8724b9458ee2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:22.956681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:22.957426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:22.957708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:22.957991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:22.970837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:22.977122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:22.978275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:22.985197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:22.994368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2b6d0-ad33-4e12-b194-6e9af09ad3a7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:22.999870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:23.000540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:23.000827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:23.001112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:23.001889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:23.002191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:23.004172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:23.013439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:23.020217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:23.029855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca2bf-27a0-42bf-948f-45d73eb40cd5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:23.035179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:23.036007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:23.036281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:23.036593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:23.037784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:23.039919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:23.041414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:23 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:23.047688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:23.058228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d1bb-10b1-48d9-9e81-bc1c7df6e4ca admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:23.063736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:23.064348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:23.064641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:23.064929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:23.073823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:23.075620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:23.085362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 41/81] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:23.091434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:23.101630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6308c-5886-4063-a795-322b9cef0d1a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:23.107073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:23.108003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:23.108277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:23.108586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:23.109795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:23.111867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872ece9-ddda-45d5-b8a0-19ed5abc9cff admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:23.113457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:23 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:23.119714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:23.129561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cb376-2594-4b97-b370-44801ebda439 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:23.135350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:23.136070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:23.136493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:23.136782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:23.137598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:23.137907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:23.139504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:23.139504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:41:23.139504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:41:23.140731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb06b4-335c-426f-b363-d4561da4f4ab admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:23.147627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:23 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:25.354165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1d1e0-28f6-46b2-990c-5119d0dcd40e None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.354760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1d1e0-28f6-46b2-990c-5119d0dcd40e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.354760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1d1e0-28f6-46b2-990c-5119d0dcd40e None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.356436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 42/84] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:25.362440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.362874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.362957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.386668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:25.387855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:25.396611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 43/85] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:25.420473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1d1e0-28f6-46b2-990c-5119d0dcd40e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.434278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1d1e0-28f6-46b2-990c-5119d0dcd40e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.439398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.440120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.440445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.440731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.452815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:25.459265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:41:25.460619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 43/86] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:25.466800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.476276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7f6ed-ea42-499d-98c3-fcab08911d63 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.481635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.482506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.482797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.483082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.483802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:25.484104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:25.485807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:25.495052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:25.500965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.511112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1815a6a-9680-4e41-bfdb-8b93a223148a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.516700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.517504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.517790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.518072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.519257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:25.521149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:25.522627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:25.528421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.538813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205354-35e8-4699-91c1-63cc9ffd6b61 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.544357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.545063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.545283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.545562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.554363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:25.556149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:25.565298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 45/89] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:25.571117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.581902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023892-8674-46fe-991b-fe6a29d905c9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.587438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.588268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.588581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.588864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.590136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:25.592438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf262-60cb-45f7-9039-934f87687eb9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:25.594014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:25.600141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:25.609811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311bc3-86be-401c-8bf1-f9a396a25041 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:25.618849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:25.619472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:25.619756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:25.620034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:25.620870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:25.621177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:25.623379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfdcd1-b8ab-42cd-8686-ecaa90f342d6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:25.630170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:25 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:27.717984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030641-6fe3-4540-b1c2-a55724416bfd None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.718575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030641-6fe3-4540-b1c2-a55724416bfd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.718575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030641-6fe3-4540-b1c2-a55724416bfd None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.720307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 46/92] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:27.726057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.726493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.726628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.751381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:27.752608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:27.761395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 47/93] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:27.784962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030641-6fe3-4540-b1c2-a55724416bfd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:27.798757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030641-6fe3-4540-b1c2-a55724416bfd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:27.803241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:27.803976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.804276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.804593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.818266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:27.824943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:41:27.826609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:41:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:27.833209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:27.843051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d4bec-c8d3-442a-913b-ee9f83cb3a81 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:27.847698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:27.848382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.848676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.848953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.849693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:27.849998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:27.851659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:27.862081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 48/95] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:27.868369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:27.878662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d5d58-06e3-4ee1-9bf2-9f5893ddf392 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:27.883323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:27.884109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.884397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.884703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.885848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:27.887653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:27.889445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:27 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:27.895172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:27.905611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347a28d-b7ee-4e77-bf99-01224fdb9d17 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:27.911146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:27.911938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.912221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.912526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.913771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:27.915867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf996c8-85d5-4173-a726-0da5f530a69f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:27.917460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:27 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:27.923802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:27.933557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe99e0f-2cea-413d-aaaf-2396ef3c3e32 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:27.938264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:27.939078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:27.939363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:27.939684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:27.941547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=724025c1e3724b58b72260918cc31b70, user_id=3fde6f358f0c4f9d97186836d44cc1d3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:27.942570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:41:27.942570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:41:27.942570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:41:27.944563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d4234-c4b3-478e-bd5f-029cfe76419b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:27.961080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 49/98] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:41:27 2021] PUT /identity/v3/projects/724025c1e3724b58b72260918cc31b70/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:41:30.049468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9536-2c62-4af6-9542-d1775f4ee3dc None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.050067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9536-2c62-4af6-9542-d1775f4ee3dc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.050067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9536-2c62-4af6-9542-d1775f4ee3dc None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.051795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 50/99] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:30.057611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.058076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.058176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.082787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:30.083999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:30.152365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 50/100] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:30.176132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9536-2c62-4af6-9542-d1775f4ee3dc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.190485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9536-2c62-4af6-9542-d1775f4ee3dc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.195539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.196288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.196591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.196871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.209977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:30.216316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:41:30.217655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 51/101] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:30.223961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.232955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08699455-3bc7-4c37-8ee4-b6acb97a181c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.237528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.238123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.238412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.238693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.239413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:30.239710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:30.241383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:30.250529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:30.256487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.266628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5ea-46a4-44e2-bc90-4ed37ed9d5b1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.272152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.273023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.273303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.273582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.274761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:30.276713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:30.278218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:30.284380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.294369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95bed-5ad0-4b5f-aa55-194a6e4006c2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.299361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.299934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.300218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.300534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.308674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:30.310512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:30.319601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 52/104] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:30.325545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.335873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8fca-40c7-4200-8a91-69f99f5b41ee admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.340908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.341797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.342084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.342367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.343487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:30.345635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2d8cb-4477-4ddb-bae8-91402f90610c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:30.347218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 53/105] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:30.353639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:30.362873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602bc5e-b2cf-45a7-8792-150b7af95409 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:30.368212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:30.368830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:30.369112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:30.369395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:30.370180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:30.370485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:30.372370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281aba-ad58-482d-ae6e-2d37115ab09f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:30.378740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:30 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:32.611791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0d00-9ef9-4ff3-9212-744c5599088b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.612391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0d00-9ef9-4ff3-9212-744c5599088b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.612391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca0d00-9ef9-4ff3-9212-744c5599088b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.614106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 54/107] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:32.619492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.619918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.620047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.643242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:32.644429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:32.652502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:32.676172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca0d00-9ef9-4ff3-9212-744c5599088b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.689349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca0d00-9ef9-4ff3-9212-744c5599088b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.693847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.694590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.694877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.695149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.707375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:32.713990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:41:32.715160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 55/109] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:32.721521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.730697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed279af-3ff7-417f-b10a-ec6fca6b165a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.735965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.736623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.736914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.737199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.737939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:32.738241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:32.739915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:32.749328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 55/110] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:32.755576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.767061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcee-e768-46a4-bcf1-681823f8bb6a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.774071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.775009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.775257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.775466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.776812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:32.779612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:32.782122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 56/111] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:32.788156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.799323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba927eb1-9eaa-4223-87b5-9938c42196e8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.804554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.805144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.805424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.805700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.815363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:32.817215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:32.827910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 56/112] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:32.834005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.844931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49c979-ce4a-4e84-afda-6cd633c9a750 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.850550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.851377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.851696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.851972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.853226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:32.855345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335d74-5716-4956-ad4f-5720917f8fc1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:32.857184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 57/113] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:32.863708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:32.873545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597a3df-5ea4-4d68-ad97-e52f59f07d96 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:32.878335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:32.878925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:32.879211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:32.879489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:32.880309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:32.880615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:32.882510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d206ee7-82f4-4b84-b1fe-0d04aecdd092 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:32.889232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 57/114] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:32 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:34.970158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca970-15a0-4e86-90c6-d30bce84adc0 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:34.970733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca970-15a0-4e86-90c6-d30bce84adc0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:34.970733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca970-15a0-4e86-90c6-d30bce84adc0 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:34.972575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 58/115] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:34.978359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:34.978819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:34.978935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.002667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:35.003805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:35.011018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 58/116] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:35.034164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ca970-15a0-4e86-90c6-d30bce84adc0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:35.048468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ca970-15a0-4e86-90c6-d30bce84adc0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:35.053412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:35.054164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:35.054451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:35.054738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.067325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:35.074045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:41:35.075244 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 59/117] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:41:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:35.081355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:35.090259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac112b-c865-4ba9-8845-3875d7797363 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:35.094748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:35.095344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:35.095635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:35.095918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.096666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:35.096967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:35.098588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:35.107321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 59/118] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:41:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:35.113034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:35.125015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027532-c27f-438b-acda-6fac07bac287 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:35.130602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:35.131429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:35.131715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:35.131996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.133312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:35.135536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:35.137186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 60/119] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:35 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:35.143202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:35.153577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe654-c484-470b-bd02-0fc04d9d6fd0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:35.158858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:35.159687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:35.159991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:35.160288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.161470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:35.163676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b478e78-069f-4c66-8c1c-a4440e9fa43f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:35.165342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 60/120] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:35 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:35.171734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:35.181776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f15c7-c1b8-46d4-a249-ef9c56b1c258 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:35.187349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:35.188195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:35.188518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:35.188797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70/users/4b441378e641415e97cd2c14dde4afda/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:35.191171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=724025c1e3724b58b72260918cc31b70, user_id=4b441378e641415e97cd2c14dde4afda, role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:35.193939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdfe07-1b2d-4d39-83c8-5af30c913bae admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:35.209010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 61/121] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:41:35 2021] PUT /identity/v3/projects/724025c1e3724b58b72260918cc31b70/users/4b441378e641415e97cd2c14dde4afda/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:41:37.275884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b2b5-1a70-456d-956c-a35e531ebf67 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.276437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b2b5-1a70-456d-956c-a35e531ebf67 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.276437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b2b5-1a70-456d-956c-a35e531ebf67 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.278065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 61/122] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:37.283937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.284392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.284496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.308276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:37.309440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:37.374463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 62/123] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:37.398061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b2b5-1a70-456d-956c-a35e531ebf67 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.412026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b2b5-1a70-456d-956c-a35e531ebf67 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.416873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.417621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.417879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.418160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.430719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:37.437579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:41:37.438719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 62/124] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:37.444744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.453781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b167904-dfb2-4555-b15e-9ada3e407f0b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.458511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.459115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.459406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.459688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.460423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:37.460722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:37.462355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:37.471236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 63/125] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:37.476903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.487153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856c2-c01d-4652-9eab-7054647ed2de admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.492720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.493470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.493733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.494015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.495278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:37.497707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:37.499195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 63/126] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:37.504640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.514383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7304-996d-4c7f-8d69-e0bf561b8ca7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.519031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.519613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.519905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.520187 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.528409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:37.530590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:37.539374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 64/127] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:37.545141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.555143 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1f92-7c21-44af-b6e1-68ef39557bf0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.560755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.561514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.561822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.562105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.563369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:37.565862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e24a5-8419-45d6-b956-207505c980ca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:37.567451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 64/128] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:37.573553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:37.582628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20755824-2602-4afe-9978-fc006b973ca1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:37.587331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:37.587916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:37.588203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:37.588515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:37.589273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=724025c1e3724b58b72260918cc31b70, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:37.589598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:37.591498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69d4f8-57df-42ca-80eb-3556c6be342d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:37.597735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 65/129] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:37 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:39.838795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566beaa-0065-44a7-95a6-99d687107883 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:39.839397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566beaa-0065-44a7-95a6-99d687107883 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:39.839397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566beaa-0065-44a7-95a6-99d687107883 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:39.841115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 65/130] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:39.846688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:39.847183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:39.847270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:39.873406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:39.874601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:39.883234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 66/131] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:39.906784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566beaa-0065-44a7-95a6-99d687107883 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:39.921151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566beaa-0065-44a7-95a6-99d687107883 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:39.925748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:39.926517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:39.926816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:39.927100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:39.940705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:39.947075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:39.948367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:39.955074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:39.966268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac868fc-bea7-4761-be4c-498e8e3ac960 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:39.971747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:39.972487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:39.972776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:39.973043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:39.973775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:39.974075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:39.975715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:39.985232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:39.991164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:40.005157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fba326-bcf3-4287-9f91-de1c4356c642 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:40.013005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:40.014075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:40.014563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:40.014983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:40.017074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:40.020639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:40.023085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:39 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:40.029432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:40.039641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ba29-365e-489c-9ffb-357ce7ebde5e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:40.044208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:40.044829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:40.045116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:40.045402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:40.053692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:40.055474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:40.064445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 68/135] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:40.070655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:40.080970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a714fd3-a390-47c7-ab23-2df8d807b12d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:40.086451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:40.087255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:40.087542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:40.087823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] PATH_INFO: `/v3/projects/513b5f1fb02e49ddb96b02dda9266275` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:40.089195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] RBAC: Authorizing `identity:get_project(project_id=513b5f1fb02e49ddb96b02dda9266275)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:40.091329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e1d0e-4662-482f-8c90-57fcb88ae049 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:40.093006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 68/136] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:40 2021] GET /identity/v3/projects/513b5f1fb02e49ddb96b02dda9266275 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:40.099125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:40.108431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51497f1-55a3-4eb3-a84f-a04c44524d50 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:40.113704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:40.114347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:40.114636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:40.114920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:40.115707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=513b5f1fb02e49ddb96b02dda9266275, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:40.116036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:40.117993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8d12-0d3e-4f57-a158-e803dcbd87c9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:40.124440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 69/137] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:40 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=513b5f1fb02e49ddb96b02dda9266275&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:42.179665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aab-24f0-48df-aa76-80c88dca32e2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.180225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aab-24f0-48df-aa76-80c88dca32e2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.180225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aab-24f0-48df-aa76-80c88dca32e2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.181917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 69/138] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:42.187615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.188067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.188173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.212381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:42.213559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:42.222191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 70/139] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:42.244759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78aab-24f0-48df-aa76-80c88dca32e2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:42.258834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78aab-24f0-48df-aa76-80c88dca32e2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:42.263771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:42.264534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.264811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.265094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.277452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:42.284064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:42.285207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 70/140] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:42.291261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:42.300383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81194e7-e620-49ff-9a69-e5d76fe13bd2 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:42.305477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:42.306083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.306375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.306657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.307510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:42.307649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:42.309363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:42.318599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 71/141] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:42.324422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:42.336676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ec388-c3f9-46b8-b7a9-428ca5a1c7c8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:42.341885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:42.342681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.342966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.343242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.344444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:42.346627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:42.348135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 71/142] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:42 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:42.353926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:42.363664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12588c7-3782-4788-b7f9-0bb0c2c5aec5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:42.368379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:42.369167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.369459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.369733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] PATH_INFO: `/v3/projects/513b5f1fb02e49ddb96b02dda9266275` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.370888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=513b5f1fb02e49ddb96b02dda9266275)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:42.373800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0985e6-852f-4832-b986-79519e6a11b3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:42.375382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 72/143] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:42 2021] GET /identity/v3/projects/513b5f1fb02e49ddb96b02dda9266275 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:42.381126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:42.391444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7fbd4-251d-4306-8810-9bb4f142db02 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:42.396396 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:42.397213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:42.397499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:42.397779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] PATH_INFO: `/v3/projects/513b5f1fb02e49ddb96b02dda9266275/users/4b441378e641415e97cd2c14dde4afda/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:42.399707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513b5f1fb02e49ddb96b02dda9266275, user_id=4b441378e641415e97cd2c14dde4afda, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:42.402448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02956-f31a-4f11-9e6f-f2318d4ada66 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:42.417447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 72/144] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:41:42 2021] PUT /identity/v3/projects/513b5f1fb02e49ddb96b02dda9266275/users/4b441378e641415e97cd2c14dde4afda/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:41:44.498034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749c6e-2a68-475f-8187-3e63523deac5 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.498585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749c6e-2a68-475f-8187-3e63523deac5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.498706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749c6e-2a68-475f-8187-3e63523deac5 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.500813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 73/145] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:44.509264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.509869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.509953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.536147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:44.537389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:44.604142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 73/146] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:41:44.627766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749c6e-2a68-475f-8187-3e63523deac5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.640804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749c6e-2a68-475f-8187-3e63523deac5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.645069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.645809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.646099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.646384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.659171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:44.665621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:44.666745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:44.672966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.686861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a643-a40a-4735-9d5f-681636e79fbd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.692282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.692995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.693281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.693535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.694317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:44.694610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:44.696363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:44.706626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 74/148] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:44.712960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.723691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969809-d415-45d8-af13-769eab3993f3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.728830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.729646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.729931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.730214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.731344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:44.733595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:44.735138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 75/149] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:44.741021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.751179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce55ce-605b-43d7-836a-91dcbd46e314 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.755627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.756320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.756471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.756787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.764796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:44.766558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:44.775030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:44.781400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.791422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb122-f29e-48c9-96ae-187b5dab8d2b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.796860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.797660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.797937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.798218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] PATH_INFO: `/v3/projects/513b5f1fb02e49ddb96b02dda9266275` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.799414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] RBAC: Authorizing `identity:get_project(project_id=513b5f1fb02e49ddb96b02dda9266275)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:44.801552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c7f2-1c23-48eb-9555-b100f7beb175 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:44.803102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/projects/513b5f1fb02e49ddb96b02dda9266275 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:44.809263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:44.818360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70c89-fc7b-486d-b403-20bf390c0f78 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:44.822913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:44.823495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:44.823779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:44.824056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:44.824859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=513b5f1fb02e49ddb96b02dda9266275, user.id=4b441378e641415e97cd2c14dde4afda) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:44.825163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:44.827152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f479-7fe2-43a9-b2cb-0915a2a43c98 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:44.833379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:44 2021] GET /identity/v3/role_assignments?user.id=4b441378e641415e97cd2c14dde4afda&scope.project.id=513b5f1fb02e49ddb96b02dda9266275&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:41:46.939916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58986-6f2d-4845-8853-511c87bb1b1f None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:46.940534 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58986-6f2d-4845-8853-511c87bb1b1f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:46.940534 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58986-6f2d-4845-8853-511c87bb1b1f None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:46.942245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 77/153] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:46.947931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:46.948371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:46.948514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:46.972949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:46.974181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:46.982529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:47.005992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58986-6f2d-4845-8853-511c87bb1b1f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:47.019871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58986-6f2d-4845-8853-511c87bb1b1f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:47.024418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:47.025149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:47.025437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:47.025718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:47.026854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:47.028687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ce67-4326-4dd9-8102-af3590f9d394 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:47.030530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 78/155] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:47.036504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:47.045503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee8d2-21da-46fb-87f6-6ded9ccdc84e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:47.050099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:47.050674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:47.050954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:47.051237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:47.051883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:47.053863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67089cfe-2b1a-455f-ab9e-a739c910166d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:47.083431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 78/156] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:41:47 2021] POST /identity/v3/projects => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:49.190700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae933-2b6c-45bf-97b1-9acc1969473b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:49.191240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae933-2b6c-45bf-97b1-9acc1969473b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:49.191240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae933-2b6c-45bf-97b1-9acc1969473b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:49.192902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 79/157] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:49.198566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:49.199017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:49.199124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:49.221989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:49.223153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:49.289801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 79/158] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:49.314229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ae933-2b6c-45bf-97b1-9acc1969473b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:49.326907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ae933-2b6c-45bf-97b1-9acc1969473b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:49.331497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:49.332260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:49.332559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:49.332836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:49.333978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:49.335686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1b1b-6062-4da8-8ed5-64928920f040 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:49.337199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 80/159] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:41:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:49.343395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:49.355233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16d5f-eda5-48d4-83fd-ee7d013a7f85 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:49.361355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:49.361957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:49.362234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:49.362514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:49.363181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:49.365201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78924a8-7757-47ea-85d0-9361775c42cd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:49.394855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 80/160] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:41:49 2021] POST /identity/v3/users => generated 283 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:41:51.614563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06fa0-4980-464d-a8e7-b6942d53e036 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.615186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06fa0-4980-464d-a8e7-b6942d53e036 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.615186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06fa0-4980-464d-a8e7-b6942d53e036 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.616850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 81/161] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:41:51.622415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.622943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.623025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.647205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:51.648499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:51.658190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 81/162] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:51.685827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06fa0-4980-464d-a8e7-b6942d53e036 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.699254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06fa0-4980-464d-a8e7-b6942d53e036 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.704397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.705130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.705413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.705685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.717793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:51.724010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:51.725152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:51.731318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.740603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949231-538a-4ba3-bf5c-2317f0b15428 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.745990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.746583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.746866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.747229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.748012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:51.748334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:51.749941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:51.767330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:51.775831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.786490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedff46f-032d-486f-96ed-248ebb5407c6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.790871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.791674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.791956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.792230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.811711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:51.813945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:51.815554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 83/165] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:51.821313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.831498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f1032-77d8-4ac0-9be2-b0ead268d7d5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.835924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.836529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.836814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.837092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.845481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:51.847231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:51.855798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 83/166] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:51.862205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.872948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0682249-6ebb-4519-baae-53e034a653d7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.878952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.879752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.880031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.880349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.881849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:51.885216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f1a7-fe3a-48ae-a6dc-7b20f7523316 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:51.887597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:51.893986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:51.902913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83756bc-8cf7-4b16-b7c3-298c19716d69 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:51.908186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:51.908868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:51.909144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:51.909429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:51.910258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=ac27d91e503144fb8fc7ac194392b17d) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:51.910561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:51.912442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fa6f-b4d2-4003-94be-67457874231c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:51.917907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:51 2021] GET /identity/v3/role_assignments?user.id=ac27d91e503144fb8fc7ac194392b17d&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:53.974110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b6a-543f-4b6e-890b-fd4095841a68 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:53.974665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b6a-543f-4b6e-890b-fd4095841a68 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:53.974665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b6a-543f-4b6e-890b-fd4095841a68 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:53.976379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 85/169] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:53.981852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:53.982465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:53.982465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.011147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:54.012368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:54.021488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 85/170] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:54.045266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc5b6a-543f-4b6e-890b-fd4095841a68 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:54.057883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc5b6a-543f-4b6e-890b-fd4095841a68 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:54.062509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:54.063397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:54.063513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:54.063803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.075951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:54.082519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:54.083883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 86/171] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:54.089874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:54.098939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea8f9-8f6d-49aa-bbc1-e8af05086589 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:54.103936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:54.104614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:54.104900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:54.105177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.105934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:54.106235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:54.108149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:54.117432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:54.123284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:54.133781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875039-a530-40ea-ac1c-46f53605f0ab admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:54.138411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:54.139223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:54.139517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:54.139794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.140935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:54.143142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:54.144668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 87/173] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:54 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:54.150479 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:54.160830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f50a3-6c9b-4671-86bd-1bea15b621fd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:54.165897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:54.166701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:54.166987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:54.167262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.168494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:54.170763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc84ee-bb3d-4dfb-b5d3-666d42c5ea7b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:54.172322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:54 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:54.177901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:54.187519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7677-6dfd-4095-b157-4483b60249eb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:54.192264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:54.193105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:54.193384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:54.193659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924/users/ac27d91e503144fb8fc7ac194392b17d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:54.195582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8435b06995c74b12b85f68f511006924, user_id=ac27d91e503144fb8fc7ac194392b17d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:54.198290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ce98-868e-470b-84e9-0d4434378c68 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:54.212002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 88/175] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:41:54 2021] PUT /identity/v3/projects/8435b06995c74b12b85f68f511006924/users/ac27d91e503144fb8fc7ac194392b17d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:41:56.290191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1786-35d5-4a45-9325-28d4ce5d287b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.290739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1786-35d5-4a45-9325-28d4ce5d287b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.290739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1786-35d5-4a45-9325-28d4ce5d287b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.292525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 88/176] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:56.298277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.298735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.298820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.321990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:56.323140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:56.394482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 89/177] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:56.417714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b1786-35d5-4a45-9325-28d4ce5d287b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.431300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b1786-35d5-4a45-9325-28d4ce5d287b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.436006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.436799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.437082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.437354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.449473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:56.455804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:41:56.457042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:56.463409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.472989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f9d7-e05a-455f-9f38-3eb436e27a6c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.477668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.478271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.478557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.478837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.479553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:56.479850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:56.481596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:56.490744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 90/179] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:56.496673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.506965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be093ab6-951c-44e4-936c-b4ffdf7a75b5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.511652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.512482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.512786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.513079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.514338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:56.516702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:56.518272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 90/180] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:56.524258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.534823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c411a3-51a4-4f75-aee4-cf706606d59e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.540093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.540771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.540999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.541270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.549748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:56.551516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:56.560402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 91/181] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:56.566410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.576670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d34c-1531-472e-9d05-67469c7bfd75 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.582017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.582794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.583072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.583447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.584643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:56.586692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87e74-9048-4a57-846d-1fff00dc9a56 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:56.588218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 91/182] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:56.594389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:56.603390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bc5c9-dd31-4661-a348-8e0270304dd7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:56.608987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:56.609563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:56.609828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:56.610096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:56.610859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] RBAC: Adding query filter params (role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=ac27d91e503144fb8fc7ac194392b17d) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:56.611152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:56.613011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfde9a6-e1bd-45af-aa0c-833c40653175 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:56.619008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 92/183] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:56 2021] GET /identity/v3/role_assignments?user.id=ac27d91e503144fb8fc7ac194392b17d&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:58.830607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69775-34d4-450c-993f-d6ee8e341708 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:58.831220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69775-34d4-450c-993f-d6ee8e341708 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:58.831220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69775-34d4-450c-993f-d6ee8e341708 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:58.832834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 92/184] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:41:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:41:58.838195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:58.838613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:58.838784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:58.861953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:41:58.863131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:41:58.870024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 93/185] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:41:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:41:58.892965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69775-34d4-450c-993f-d6ee8e341708 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:58.907034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f69775-34d4-450c-993f-d6ee8e341708 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:58.911905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:58.912653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:58.912932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:58.913203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:58.925459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:41:58.931669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:41:58.932784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 93/186] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:41:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:41:58.938909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:58.947849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6b627-997d-49d9-9459-761614bcea25 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:58.952592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:58.953193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:58.953471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:58.953742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:58.954453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:58.954748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:58.956364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:58.965251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 94/187] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:41:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:58.971135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:58.983206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d85fb-dc3f-4d0b-8035-af7dee63f6f2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:58.988603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:58.989414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:58.989686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:58.989955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:58.991192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:58.993040 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:58.994504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 94/188] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:41:58 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:59.000277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:59.010470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cac7a-fca5-411e-a540-093e914e84f1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:59.016385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:59.016974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:59.017279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:59.017645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:59.026761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:59.029506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:59.039246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 95/189] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:41:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:41:59.045549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:59.055561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19d6c-4a3e-4971-94dc-706054be134a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:59.061058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:59.061814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:59.062079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:59.062350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:59.063544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:59.065657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb2ce0-99c6-4239-afbd-f289c8d247e6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:59.067262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:41:59 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:41:59.073352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:41:59.082725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315743b-5d7a-442e-b4d2-2496ee8ec0fc admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:41:59.087854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:41:59.088483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:41:59.088858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:41:59.089024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:41:59.089790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:41:59.090073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:41:59.092465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e943-fe26-46f9-a951-590aadef02aa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:41:59.098690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 96/191] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:41:59 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:01.149601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce475-c02c-407c-8a7c-9f32ea437d9c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.150108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce475-c02c-407c-8a7c-9f32ea437d9c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.150108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ce475-c02c-407c-8a7c-9f32ea437d9c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.151697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 96/192] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:01.157979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.158574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.158574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.181444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:01.182594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:01.190091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 97/193] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:01.212764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce475-c02c-407c-8a7c-9f32ea437d9c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:01.225822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ce475-c02c-407c-8a7c-9f32ea437d9c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:01.230472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:01.231260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.231579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.231856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.245507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:01.251888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:42:01.253098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 97/194] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:42:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:01.259705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:01.271406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ce02-fc13-4eb3-a986-4bbcea41b52a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:01.276549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:01.277200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.277480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.277751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.278703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:01.278995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:01.280953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:01.290584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 98/195] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:01.297155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:01.307526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e9ce-811a-4699-9153-036fb75b6638 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:01.312086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:01.312912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.313188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.313460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.314580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:01.316513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:01.318018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:42:01 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:01.323924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:01.334026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a078-08f4-4015-89b2-efb8f4fd828b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:01.339023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:01.339817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.340102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.340461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.341884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:01.343937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cb41f-983b-410e-83f9-98d65324cce9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:01.345510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 99/197] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:01 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:01.351462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:01.361644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7387-b3ca-43ad-9f50-af24f214a3e4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:01.365853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:01.366668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:01.366948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:01.367218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:01.369005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8435b06995c74b12b85f68f511006924, user_id=3fde6f358f0c4f9d97186836d44cc1d3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:01.371680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0448c61-aefe-45f6-8c23-2ef109cfe7a4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:01.386570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 99/198] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:42:01 2021] PUT /identity/v3/projects/8435b06995c74b12b85f68f511006924/users/3fde6f358f0c4f9d97186836d44cc1d3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:03.452085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79873-0d01-4951-8fbb-1c647e23a7e7 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.452706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79873-0d01-4951-8fbb-1c647e23a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.452706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79873-0d01-4951-8fbb-1c647e23a7e7 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.454390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 100/199] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:03.459777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.460271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.460361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.483234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:03.484421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:03.553228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 100/200] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:03.576674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c79873-0d01-4951-8fbb-1c647e23a7e7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.591984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c79873-0d01-4951-8fbb-1c647e23a7e7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.596654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.597397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.597693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.597968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.610388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:03.616687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:42:03.617824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:03.627228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.639658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81be5c3-3c21-4cdc-b6e3-6078066557eb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.643960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.644603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.644893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.645194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.645934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:03.646230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:03.647832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:03.657352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 101/202] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:42:03.663492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.673364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3ad4a-c29d-4cb2-90f6-5e98b24dd7d0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.678180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.678991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.679272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.679551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.680761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:03.682586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:03.684126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 102/203] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:03.690103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.699980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fdd58-57ec-4237-bfd5-7cc80da91dc2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.704299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.704817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.705099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.705376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.713416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:03.715170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:03.723911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 102/204] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:03.729832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.739940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a5332-12f5-48fb-9f66-333911c6d099 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.744541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.745353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.745633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.745904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.747062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:03.749187 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ca348-9d93-4b9e-8792-a5824bb4b360 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:03.750743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:03.756782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:03.765910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbfe67-8765-4968-91e9-67bc5c015973 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:03.770615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:03.771201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:03.771559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:03.771766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:03.772596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=3fde6f358f0c4f9d97186836d44cc1d3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:03.772903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:03.774748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45236dc-28bf-4942-af5d-7111d0390262 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:03.781438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 103/206] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:42:03 2021] GET /identity/v3/role_assignments?user.id=3fde6f358f0c4f9d97186836d44cc1d3&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:06.031278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa053e0-e473-4ff3-9427-f53e6e439ade None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.031829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa053e0-e473-4ff3-9427-f53e6e439ade None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.031829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa053e0-e473-4ff3-9427-f53e6e439ade None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.033595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 104/207] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:06.039322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.039788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.039877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.063290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:06.064646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:06.072096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 104/208] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:42:06.095873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa053e0-e473-4ff3-9427-f53e6e439ade None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.109255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa053e0-e473-4ff3-9427-f53e6e439ade None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.119224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.119981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.120264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.120562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.133415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:06.140352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:06.141496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 105/209] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:06.147533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.157077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6c06-86f1-407e-aa65-69f774c6de25 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.162376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.162956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.163235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.163505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.164212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:06.164535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:06.166099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:06.175669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 105/210] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:06.181561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.192418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5e477-f333-4dc5-9378-79d8217173ec admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.197843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.198658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.198944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.199230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.201023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:06.203238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:06.204815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 106/211] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:06.210765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.221178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86ec17-6b9e-4834-922f-6bc030e0de49 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.226522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.227087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.227369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.227639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.236534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:06.238281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:06.247351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 106/212] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:06.253258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.263336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f780-c7cd-4d52-88cd-628e2812260b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.268362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.269202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.269483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.269760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.270939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:06.273040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a965485-21cc-4891-880a-08b172daf375 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:06.274876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 107/213] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:06.281764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:06.290977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d840a-8d66-4dda-b589-a9df9b79065d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:06.296552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:06.297133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:06.297409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:06.297687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:06.298484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=ac27d91e503144fb8fc7ac194392b17d) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:06.298778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:06.300647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8443db-9551-4c38-976f-7a39015dc467 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:06.306547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 107/214] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:42:06 2021] GET /identity/v3/role_assignments?user.id=ac27d91e503144fb8fc7ac194392b17d&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:08.373696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7585-88de-4a68-bdd5-74190e28c409 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.374295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7585-88de-4a68-bdd5-74190e28c409 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.374295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7585-88de-4a68-bdd5-74190e28c409 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.375916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 108/215] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:42:08.381414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.381860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.381971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.406274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:08.407452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:08.416010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 108/216] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:08.439719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb7585-88de-4a68-bdd5-74190e28c409 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:08.454040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb7585-88de-4a68-bdd5-74190e28c409 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:08.458685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:08.459443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.459721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.460000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.472561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:08.479115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:08.480330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 109/217] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:08.486866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:08.495664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcee17f-71c8-4f47-9ba7-5980d1f5fca2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:08.500144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:08.500767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.501052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.501332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.502073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:08.502370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:08.504056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:08.513220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 109/218] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:08.519718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:08.531399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4250b8-5e1c-42a8-98cd-84b66be49987 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:08.535852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:08.536701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.536981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.537250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.538372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:08.540569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:08.542044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 110/219] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:42:08 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:42:08.548341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:08.557992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639c88-c0c0-44a1-b264-4bc7653218d3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:08.563323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:08.564126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.564447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.564735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.565872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:08.567952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ab11a-8e9a-43f9-aa66-a422872e3fb1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:08.569569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 110/220] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:08 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:08.575757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:08.590096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516d40-5e39-4ff9-acda-29a3ef049fbb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:08.596108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:08.596976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:08.597266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:08.597542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924/users/ac27d91e503144fb8fc7ac194392b17d/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:08.599762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8435b06995c74b12b85f68f511006924, user_id=ac27d91e503144fb8fc7ac194392b17d, role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:08.602439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c630f3-dcfc-4d63-8418-bf9d7619e51a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:08.619097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 111/221] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:42:08 2021] PUT /identity/v3/projects/8435b06995c74b12b85f68f511006924/users/ac27d91e503144fb8fc7ac194392b17d/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:10.768815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf78a4-0ec9-4424-9e7e-a6aa81121617 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:10.769375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf78a4-0ec9-4424-9e7e-a6aa81121617 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:10.769375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf78a4-0ec9-4424-9e7e-a6aa81121617 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:10.771082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 111/222] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:10.776757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:10.777257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:10.777257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:10.800357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:10.801496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:10.868447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 112/223] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:42:10.891506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf78a4-0ec9-4424-9e7e-a6aa81121617 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:10.905691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf78a4-0ec9-4424-9e7e-a6aa81121617 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:10.910802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:10.911577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:10.911863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:10.912136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:10.924998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:10.931716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:10.932985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 112/224] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:42:10.939321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:10.950920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb5fb3-cedd-4b81-a948-76466a37b1f2 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:10.957930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:10.958820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:10.959212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:10.959617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:10.960774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:10.961183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:10.963526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:10.973146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 113/225] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:10.978916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:10.988786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524d62-e4b5-49c8-b4e1-0002f543c927 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:10.993956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:10.994741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:10.995017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:10.995285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:10.996514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:10.998702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:11.000156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 113/226] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:42:10 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:11.005591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:11.015686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1aa1-1b40-40f1-8cd6-ded3a2eda484 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:11.022302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:11.023005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:11.023301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:11.023587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:11.032854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:11.034683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:11.043621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 114/227] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:11.049978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:11.060094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3c69-f91f-4923-87ff-1cdfae07ce82 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:11.064675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:11.065453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:11.065734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:11.066010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:11.067177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:11.069277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c6ff-f6fe-446f-98f6-8ec23ded3dd7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:11.070849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 114/228] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:11 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:11.077115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:11.086073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f63c-ee41-486d-aad7-60aa271af2f8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:11.091294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:11.091872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:11.092152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:11.092454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:11.093228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=8435b06995c74b12b85f68f511006924, user.id=ac27d91e503144fb8fc7ac194392b17d) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:11.093530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:11.095420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8cac-29cf-4657-bf9f-ac14b7aa2895 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:11.101444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 115/229] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:42:11 2021] GET /identity/v3/role_assignments?user.id=ac27d91e503144fb8fc7ac194392b17d&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:13.222524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431e20-b371-4d4a-9e67-7ff4c92b5937 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:13.223053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431e20-b371-4d4a-9e67-7ff4c92b5937 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:13.223053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6431e20-b371-4d4a-9e67-7ff4c92b5937 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:13.224700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 115/230] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:13.230247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:13.230675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:13.230776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:13.253605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:13.254760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:13.263538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 116/231] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:42:13.286405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6431e20-b371-4d4a-9e67-7ff4c92b5937 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:13.298888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6431e20-b371-4d4a-9e67-7ff4c92b5937 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:13.303186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:13.303919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:13.304197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:13.304504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:13.305623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:13.307287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05d29-6eea-420d-b401-b81c6f8251fc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:13.308811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 116/232] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:42:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:13.314710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:13.323857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f823b-0c3d-4c33-82ba-f17897352262 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:13.329264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:13.329873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:13.330158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:13.330404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] PATH_INFO: `/v3/groups` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:13.331054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:13.332110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:13.332110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:42:13.332110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:42:13.333312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e353-347d-46c6-93d1-c9d1f831f344 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:13.350109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 117/233] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:42:13 2021] POST /identity/v3/groups => generated 229 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:42:15.426700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6bc0a-a152-4cfc-b46d-40c19fbf173c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:15.427299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6bc0a-a152-4cfc-b46d-40c19fbf173c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:15.427299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6bc0a-a152-4cfc-b46d-40c19fbf173c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:15.428948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 117/234] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:15.434309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:15.434749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:15.434851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:15.457262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:15.458387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:15.465899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 118/235] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:15.488470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6bc0a-a152-4cfc-b46d-40c19fbf173c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:15.501302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6bc0a-a152-4cfc-b46d-40c19fbf173c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:15.505749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:15.506465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:15.506745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:15.507022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:15.508148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:15.509855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee81e3-5616-429b-ae8e-ba7b0eab5212 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:15.511310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 118/236] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:42:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:15.517255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:15.526529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286445-0870-4251-af3f-f09e4d0ce90b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:15.531743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:15.532382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:15.532665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:15.532946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] PATH_INFO: `/v3/groups` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:15.533564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:15.535524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdfa-55a9-45e6-a67b-b91a58df2713 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:15.551851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 119/237] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:42:15 2021] POST /identity/v3/groups => generated 226 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:42:17.726449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d66b2-9dfc-4aaf-8064-32f2c070d9b3 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.727045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d66b2-9dfc-4aaf-8064-32f2c070d9b3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.727045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d66b2-9dfc-4aaf-8064-32f2c070d9b3 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.728734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 119/238] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:17.734022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.734464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.734562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.758248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:17.759357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:17.767823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 120/239] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:17.791141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d66b2-9dfc-4aaf-8064-32f2c070d9b3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.805458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d66b2-9dfc-4aaf-8064-32f2c070d9b3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.810412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.811186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.811418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.811699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.823865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:17.830252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:17.831351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:17.837404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.846515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293a51-b96d-427f-90ee-7dcad053ce10 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.851082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.851677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.851963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.852265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.852979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:17.853275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:17.854897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:17.864082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 121/241] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:17.869874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.879923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cb91-b6c7-41e8-bcc2-b1f86a7b715e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.885341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.885907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.886186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.886461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.894924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:17.896728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:17.905732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 121/242] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:17.911770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.921833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f20ab-2ae8-4182-ac3d-ff92c9414184 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.926810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.927603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.927878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.928154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.929375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:17.931454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:17.933042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 122/243] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:17.939121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.948276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26a38-0174-4be6-8967-5c2c5575bfbf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.953561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.954366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.954647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.954917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.961771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:17.962800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:17.962800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:42:17.962800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:42:17.963999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edcdac-b21f-4234-aa7f-5c66b591f9d6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:17.965764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 122/244] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:17.972274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:17.983036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e5b8-a8c2-4792-933c-eb8125ac9038 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:17.988226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:17.988872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:17.989149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:17.989422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:17.990210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=724025c1e3724b58b72260918cc31b70) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:17.990507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:17.992394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4499-0cbb-4a5e-8d5d-b39226f4e937 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:18.000549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 123/245] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:17 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:20.084644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7033-6cba-49e5-abf8-8c3b0cdfcc5f None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.085215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7033-6cba-49e5-abf8-8c3b0cdfcc5f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.085215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7033-6cba-49e5-abf8-8c3b0cdfcc5f None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.086961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 123/246] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:20.092638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.093097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.093181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.127399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:20.128591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:20.135908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 124/247] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:20.158546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7033-6cba-49e5-abf8-8c3b0cdfcc5f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:20.171322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7033-6cba-49e5-abf8-8c3b0cdfcc5f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:20.175762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:20.176522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.176804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.177074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.189553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:20.195834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:20.197087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 124/248] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:20.203314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:20.212717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d02e6a-1545-4ead-a1f0-1c366fe65c63 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:20.218477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:20.219105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.219388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.219662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.220419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:20.220708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:20.222333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:20.231911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 125/249] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:20.237841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:20.248641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6aa4b-c330-49ef-a417-2d227dd5eae2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:20.253505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:20.254286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.254575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.254836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.255976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:20.257926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:20.259507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 125/250] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:20 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:20.265818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:20.276693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce90a5-5ff8-467d-979e-a9eba05e8173 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:20.283268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:20.284391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.284683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.284964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.286151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:20.288256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc072cc-55a6-4c20-aa62-79bb8539a520 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:20.289848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 126/251] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:20 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:20.297058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:20.307033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f19de3-fa7f-40eb-9dac-cfdc5e0cfc55 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:20.312788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:20.313605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:20.313884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:20.314158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70/groups/7dab95e065df4d878db46e36a74860fe/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:20.316200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724025c1e3724b58b72260918cc31b70, group_id=7dab95e065df4d878db46e36a74860fe, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:20.318886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418ebd-b45b-4b43-9fc4-6edb2e354437 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:20.333595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 126/252] 10.222.0.60 () {58 vars in 1463 bytes} [Tue Nov 23 12:42:20 2021] PUT /identity/v3/projects/724025c1e3724b58b72260918cc31b70/groups/7dab95e065df4d878db46e36a74860fe/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:22.451433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72062a-500c-497d-9955-1f85b8123945 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.452004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72062a-500c-497d-9955-1f85b8123945 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.452004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72062a-500c-497d-9955-1f85b8123945 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.453704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 127/253] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:22.459313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.459777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.459871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.483536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:22.484734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:22.553910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 127/254] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:22.577430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72062a-500c-497d-9955-1f85b8123945 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.590310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72062a-500c-497d-9955-1f85b8123945 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.594874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.595609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.595894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.596166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.608495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:22.614753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:22.615883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 128/255] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:42:22.621963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.631043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa92b-8bfe-4bb6-9e62-6676b89798f0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.636531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.637189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.637509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.637779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.638504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:22.638798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:22.640440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:22.649579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 128/256] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:22.655462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.665858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e43a-a22e-4aa9-95dc-a7f4ab6f5685 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.671425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.671963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.672273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.672550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.680851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:22.682608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:22.691461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 129/257] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:22.697233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.711378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c405-14ce-484e-bf2c-890eabaefad6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.718113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.718926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.719208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.719488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.720778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:22.722847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:22.724438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 129/258] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:22.730471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.742678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e327fa-05a8-4e36-b5bc-fc6f94d0b912 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.747332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.748113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.748451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.748722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.749904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:22.750943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:22.750943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:42:22.750943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:42:22.752142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ec18b-2a9a-4ec5-8726-b8d1976c3c0b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:22.753650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 130/259] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:22.759572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:22.769901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633cfb-a62c-4c0c-ad9b-9d7fcb7889c2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:22.774713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:22.775274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:22.775553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:22.775821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:22.776624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=724025c1e3724b58b72260918cc31b70) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:22.776924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:22.778997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67050f4d-0899-46e1-bce7-bdcc640833eb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:22.785207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 130/260] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:22 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:42:24.991888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a4d-2455-4155-9940-cb0b8bad67b1 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:24.992549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a4d-2455-4155-9940-cb0b8bad67b1 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:24.992549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a4d-2455-4155-9940-cb0b8bad67b1 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:24.994205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 131/261] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:24.999676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.000146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.000263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.023962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:25.025735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:25.034917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 131/262] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:25.058321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7a4d-2455-4155-9940-cb0b8bad67b1 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.071327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7a4d-2455-4155-9940-cb0b8bad67b1 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.075771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.076560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.076838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.077111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.088878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:25.095986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:25.097149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 132/263] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:25.103340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.112898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb294a-fc36-4a77-831f-346aca9a2227 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.118051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.118686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.118969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.119249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.120089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:25.120424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:25.122201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:25.131965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 132/264] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:25.138270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.148556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6186-bb66-4940-93c0-e613f204dfdd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.153132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.153871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.154502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.154774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.162729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:25.164513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:25.173041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 133/265] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:25.178946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.189077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3042d73-1902-4711-a217-cc3d7c65a3c6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.194484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.195291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.195529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.195839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.197165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:25.199673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:25.201344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 133/266] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:25.207291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.216990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b8d-f988-47bc-99bf-c7dcad6ba744 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.222023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.222820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.223098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.223378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.224583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:25.226495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004abc6-f170-4a81-8e1c-e5a782b12981 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:25.227985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 134/267] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:25.234054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:25.244612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cf6e5-e703-4fa8-88db-c2e78e696857 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:25.250033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:25.250610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:25.250893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:25.251167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:25.251953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=724025c1e3724b58b72260918cc31b70) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:25.252269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:25.254164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f52c45-84b5-4ab9-b8f6-e38336a3756b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:25.259976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 134/268] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:25 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:27.313839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01708-b893-43d8-b730-722326e5ee1e None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.314432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01708-b893-43d8-b730-722326e5ee1e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.314432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01708-b893-43d8-b730-722326e5ee1e None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.316142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 135/269] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:27.321867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.322323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.322439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.346309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:27.347459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:27.356623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 135/270] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:27.379311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01708-b893-43d8-b730-722326e5ee1e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:27.398017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01708-b893-43d8-b730-722326e5ee1e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:27.403616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:27.404732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.405015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.405289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.417073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:27.424017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:27.425253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 136/271] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:27.431640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:27.441048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ff4da-3c81-40de-86a6-3b4d9a7e86ea None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:27.446420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:27.447027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.447308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.447580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.448325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:27.448619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:27.450378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:27.459377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 136/272] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:27.465542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:27.475747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27cffa-65aa-451b-8e95-7c2835c379ad admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:27.480384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:27.481390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.481653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.481936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.483067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:27.485014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:27.486486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 137/273] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:27 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:27.492174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:27.504333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940060-b268-4bfe-80a7-e0cf39ad8d66 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:27.509047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:27.509849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.510135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.510415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.511681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:27.513813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ab61-a058-47cb-af59-2e402d4ba72c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:27.515392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 137/274] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:27 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:27.521400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:27.531728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e728-a959-4675-80ff-01c3280feed2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:27.536041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:27.536913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:27.537196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:27.537471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70/groups/7dab95e065df4d878db46e36a74860fe/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:27.539464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=724025c1e3724b58b72260918cc31b70, group_id=7dab95e065df4d878db46e36a74860fe, role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:27.542134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae35179-ff26-4857-9c7b-a95d6f26ef4d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:27.557554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 138/275] 10.222.0.60 () {58 vars in 1463 bytes} [Tue Nov 23 12:42:27 2021] PUT /identity/v3/projects/724025c1e3724b58b72260918cc31b70/groups/7dab95e065df4d878db46e36a74860fe/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:42:29.659948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2226f16-f404-47f8-b977-b705fbe90b96 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.660577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2226f16-f404-47f8-b977-b705fbe90b96 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.660577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2226f16-f404-47f8-b977-b705fbe90b96 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.662238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 138/276] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:29.667700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.668185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.668315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.692002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:29.693191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:29.758692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 139/277] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:29.782344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2226f16-f404-47f8-b977-b705fbe90b96 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.796186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2226f16-f404-47f8-b977-b705fbe90b96 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.801275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.802034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.802318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.802596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.815332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:29.822095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:29.823368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 139/278] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:29.829635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.838611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87faca-4bff-4aea-bdef-d0957c10b671 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.843130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.843735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.844021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.844314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.845052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:29.845350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:29.846952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:29.855940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 140/279] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:29.861836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.871536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f7c68-3568-4fc0-abf1-f66ddc3fdcca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.875790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.876389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.876672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.876934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.884744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:29.886497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:29.895019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 140/280] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:29.900864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.911255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e989-d0bf-4a85-8fde-8431ad23b8e7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.916258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.917114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.917399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.917677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.919049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:29.921164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:29.922780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 141/281] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:29.931141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.940372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366fb9-0a1d-4891-bb04-1cf3f709704f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.945357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.946148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.946425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.946701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.947961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:29.950025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bacb26-cfe7-4096-9b8c-ef89c8b75885 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:29.951542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 141/282] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:29.957643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:29.967582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852ab2-cb93-4e40-956b-2be08567763c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:29.972216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:29.972819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:29.973098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:29.973372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:29.974140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=724025c1e3724b58b72260918cc31b70) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:29.974437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:29.976296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a123d8-9ed4-4741-9f7b-3cb201128830 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:29.982334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:29 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=724025c1e3724b58b72260918cc31b70&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:32.178650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc43cc-b911-418e-a78d-296ba10f491f None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.179176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc43cc-b911-418e-a78d-296ba10f491f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.179176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc43cc-b911-418e-a78d-296ba10f491f None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.180847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 142/284] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:32.186446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.186876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.187132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.210933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:32.212105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:32.220651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 143/285] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:32.243854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc43cc-b911-418e-a78d-296ba10f491f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.256662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc43cc-b911-418e-a78d-296ba10f491f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.261153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.261905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.262186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.262453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.274015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:32.280743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:32.281832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 143/286] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:32.288016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.297571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bdfb7-c891-4c5f-94e0-0c74b37eb9bb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.302931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.303545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.303823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.304096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.304842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:32.305141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:32.306760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:32.315952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 144/287] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:32.321649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.332501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda321-6d5e-4629-a2cb-cc31c25a0c32 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.337231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.337793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.338075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.338353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.346335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:32.348091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:32.356652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:42:32.362387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.372521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd75b48-96f2-4683-888e-ddc73254253d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.377650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.378436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.378719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.378991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.380173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:32.382279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:32.383819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 145/289] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:32.389417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.398130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a560ab2-e7c1-4c39-a71b-e1180b017ce3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.403687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.404827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.405104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.405376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.406613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:32.408503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db2759-48f3-4071-8883-d2fd5283effb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:32.409957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 145/290] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:32.415654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:32.425885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628004c-447e-4b03-a96f-bdbcc14400a3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:32.431359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:32.431868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:32.432133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:32.432436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:32.433224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=8435b06995c74b12b85f68f511006924) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:32.433632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:32.435689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b26676-7967-44bc-9ea1-afff158d6cbe admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:32.441519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 146/291] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:32 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:34.517302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548eab-3d2c-45e0-a770-c9bb621d14fa None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.517933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548eab-3d2c-45e0-a770-c9bb621d14fa None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.517933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548eab-3d2c-45e0-a770-c9bb621d14fa None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.519596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 146/292] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:34.526049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.526781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.526947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.557855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:34.559058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:34.568885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 147/293] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:34.593444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548eab-3d2c-45e0-a770-c9bb621d14fa None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:34.608203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548eab-3d2c-45e0-a770-c9bb621d14fa None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:34.613922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:34.614659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.614953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.615231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.628772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:34.635077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:34.636209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 147/294] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:34.645355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:34.654920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7d2cc-ed74-4b6a-8b13-b5bdfc47641e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:34.660722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:34.661366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.661590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.661859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.662562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] RBAC: Adding query filter params (name=member) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:34.662841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:34.664461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:34.673912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 148/295] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:34.679916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:34.691360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910add7-62c8-4c6c-b7a8-78d00b40fc66 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:34.696326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:34.697096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.697376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.697650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.698751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:34.700688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:34.702153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 148/296] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:34 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:34.710617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:34.722359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42897-3e28-4fbd-8c59-5bdaac088dba admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:34.727569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:34.728393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.728674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.728945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.730211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:34.732515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a612ecc-c44b-4cc5-a501-9d69499f6e0e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:34.734015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 149/297] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:34 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:34.739679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:34.749250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5078c2f-6b03-43f9-9f83-9cb33e10a550 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:34.754159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:34.754944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:34.755198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:34.755488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924/groups/7dab95e065df4d878db46e36a74860fe/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:34.757537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8435b06995c74b12b85f68f511006924, group_id=7dab95e065df4d878db46e36a74860fe, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:34.760097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e465c-473a-43cb-a1e5-6805ac3dfc8c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:34.776511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1463 bytes} [Tue Nov 23 12:42:34 2021] PUT /identity/v3/projects/8435b06995c74b12b85f68f511006924/groups/7dab95e065df4d878db46e36a74860fe/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:36.859071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0b8b-d6ea-4c65-a010-4675fae57270 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:36.859903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0b8b-d6ea-4c65-a010-4675fae57270 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:36.859903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0b8b-d6ea-4c65-a010-4675fae57270 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:36.862517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 150/299] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:36.867801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:36.868331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:36.868437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:36.891835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:36.893007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:36.960845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 150/300] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:42:36.984699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0b8b-d6ea-4c65-a010-4675fae57270 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.002668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0b8b-d6ea-4c65-a010-4675fae57270 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.007893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.008658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.008946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.009224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.021906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:37.028388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 12:42:37.029793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 151/301] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:37.038749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.053051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8237-17f8-427a-a127-fc7ce8dae7a7 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.060803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.061393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.061675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.061950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.062665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:37.062959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:37.064728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:37.073878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 151/302] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:42:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:37.079754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.090506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f3c2-73fc-450e-b603-878465d1f35d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.095829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.096454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.096735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.096996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.105150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:37.107211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:37.115883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 152/303] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:37.121963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.135015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d150-c6aa-4b33-9595-94f00a27665b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.140875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.141945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.142229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.142503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.143859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:37.146403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:37.147968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 152/304] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:37 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:37.155939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.170684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9082-8528-4301-8328-d5065aae298d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.179158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.180307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.180661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.181030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.182827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:37.185332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fe88-e065-453b-8284-b4b8ab46bb23 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:37.186796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 153/305] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:37 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:37.192620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:37.202446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e16c5-2a8b-4d0d-a03b-a38bb3127043 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:37.207775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:37.208387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:37.208670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:37.208944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:37.209728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=45348a9ac36945cc8b1051e879a0eaa7, scope.project.id=8435b06995c74b12b85f68f511006924) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:37.210026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:37.211861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef57816-dc0b-4500-935f-b412556520eb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:37.218039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 153/306] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:37 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=45348a9ac36945cc8b1051e879a0eaa7 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:39.394504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb45d9-2908-46f3-b0b0-3e58b7129062 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.395505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb45d9-2908-46f3-b0b0-3e58b7129062 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.395505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb45d9-2908-46f3-b0b0-3e58b7129062 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.398153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 154/307] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:39.406418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.406859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.406985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.439692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:39.440860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:39.448643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 154/308] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:39.472294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb45d9-2908-46f3-b0b0-3e58b7129062 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.493615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb45d9-2908-46f3-b0b0-3e58b7129062 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.500276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.501030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.501313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.501588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.514011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:39.520753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:39.521921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 155/309] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:39.528151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.537822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f3c3-2017-4a73-b23b-b5986ca84d91 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.543350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.543953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.544268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.544576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.545301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:39.545593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:39.547179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:39.556144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 155/310] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:39.562064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.572491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a032-1ca4-403d-ac9e-e48fcc42570f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.577825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.578394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.578671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.578940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.587297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:39.589095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:39.597849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 156/311] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:39.604123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.614444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61402-cb2d-425c-8f2b-3ea1d43f4e18 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.619756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.620590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.620925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.621250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.622463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:39.624521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:39.626060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 156/312] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:39.631413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.639987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946d5e3-ef8f-4edb-a2a2-0cd23ccda295 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.644658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.645363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.645641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.645916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.647019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:39.648957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9a66-d35b-4aa0-9671-adb866e6e16d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:39.650386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 157/313] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:39.657029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:39.666770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41181-ebfd-4ab6-b741-7c47e75c0596 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:39.671703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:39.672285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:39.672582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:39.672858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:39.673664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=8435b06995c74b12b85f68f511006924) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:39.673962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:39.675804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd10e9-44ed-4f69-a198-e83d2be86c33 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:39.681717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 157/314] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:39 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:41.729608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21518c-fe21-431c-af1d-0b67b3aaf4c3 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.730514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21518c-fe21-431c-af1d-0b67b3aaf4c3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.730514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21518c-fe21-431c-af1d-0b67b3aaf4c3 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.733235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 158/315] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:41.742077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.742516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.742676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.767484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:41.768673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:41.776910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 158/316] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:41.806103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21518c-fe21-431c-af1d-0b67b3aaf4c3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:41.820791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21518c-fe21-431c-af1d-0b67b3aaf4c3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:41.826714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:41.827470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.827767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.828041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.840435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:41.847133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:41.848288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 159/317] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:41.854995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:41.865083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87420d54-3258-4f5d-96a9-e69346aba733 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:41.871139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:41.871728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.872006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.872278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.873017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:41.873310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:41.874908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:41.884344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 159/318] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:41.893121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:41.909139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b02-0655-4d55-86ea-5ca8253b2b1b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:41.917136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:41.918345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.918709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.919131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.920602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:41.922529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:41.924014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 160/319] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:41 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:41.932079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:41.942002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9dc46-1a7b-466e-8450-5cb3df626893 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:41.947747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:41.948602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.948880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.949152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.950447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:41.952692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e9c0-6213-4cb0-ba51-5cf5b2847aae admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:41.954231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 160/320] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:41 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:41.959930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:41.975049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e4cd9-0c02-422a-ab97-87bdf3575673 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:41.980679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:41.981453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:41.981766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:41.982116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924/groups/7dab95e065df4d878db46e36a74860fe/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:41.984261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8435b06995c74b12b85f68f511006924, group_id=7dab95e065df4d878db46e36a74860fe, role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:41.986959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb15f0-d897-468b-9e2e-f5b310901509 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:42.003832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 161/321] 10.222.0.60 () {58 vars in 1463 bytes} [Tue Nov 23 12:42:41 2021] PUT /identity/v3/projects/8435b06995c74b12b85f68f511006924/groups/7dab95e065df4d878db46e36a74860fe/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:44.081557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52f7c-185d-4de4-9472-2625cf072aaa None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.082145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52f7c-185d-4de4-9472-2625cf072aaa None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.082145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52f7c-185d-4de4-9472-2625cf072aaa None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.083784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 161/322] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:44.089416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.089809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.089925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.114386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:44.115572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:44.186378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 162/323] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:44.215488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52f7c-185d-4de4-9472-2625cf072aaa None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.229891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52f7c-185d-4de4-9472-2625cf072aaa None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.235782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.236552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.236842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.237122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.250380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:44.257054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:42:44.258159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 162/324] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:44.264890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.279830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f878ec-b894-4c1d-afc9-057d8dac1f73 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.288727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.289602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.289993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.290392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.291502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:44.291951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:44.294624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:44.303779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 163/325] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:42:44.310047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.324297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bd60-7e11-4863-928d-e6c02f1018d4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.329774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.330372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.330649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.330921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.339748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:44.341540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:44.350934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 163/326] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:44.359485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.370219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e834d5-736a-427a-ac24-f4080c0c14a7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.376441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.377247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.377525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.377804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.379112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:44.381215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:44.382775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 164/327] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:44.389071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.402648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228bcd-055c-4a93-afb3-2a75698a217f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.409302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.410081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.410364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.410639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] PATH_INFO: `/v3/groups/7dab95e065df4d878db46e36a74860fe` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.411883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] RBAC: Authorizing `identity:get_group(group_id=7dab95e065df4d878db46e36a74860fe)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:44.413820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8271-4484-4e2a-a092-5f32ba314c69 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:44.415278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 164/328] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/groups/7dab95e065df4d878db46e36a74860fe => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:44.424300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:44.438194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade5bd-597e-48fd-8777-64997c684344 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:44.443957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:44.444562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:44.444841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:44.445111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:44.445892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] RBAC: Adding query filter params (group.id=7dab95e065df4d878db46e36a74860fe, role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=8435b06995c74b12b85f68f511006924) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:44.446181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:44.448012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590793d-d03f-497a-afda-e3ff889e7afa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:44.454975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 165/329] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:44 2021] GET /identity/v3/role_assignments?group.id=7dab95e065df4d878db46e36a74860fe&scope.project.id=8435b06995c74b12b85f68f511006924&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:46.645169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558e26b-6feb-40f3-bf57-c3456234236b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.645738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558e26b-6feb-40f3-bf57-c3456234236b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.645738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558e26b-6feb-40f3-bf57-c3456234236b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.648250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 165/330] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:46.656120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.656566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.656703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.680543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:46.681666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:46.692972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:46.724850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558e26b-6feb-40f3-bf57-c3456234236b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.740275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558e26b-6feb-40f3-bf57-c3456234236b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.746271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.747007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.747287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.747611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.761289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:46.771400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:42:46.773206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 166/332] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:46.780091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.789797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825d5d3-8331-4752-b166-7d8a9382b56e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.795495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.796096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.796406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.796692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.797414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:46.797710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:46.799329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:46.808626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 167/333] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:46.814362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.826633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784361-a974-4123-8b83-2e447e014c59 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.831235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.831814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.832097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.832357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.841373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:46.843122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:46.851942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 167/334] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:46.858004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.868426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf36fc-20f2-4fee-874a-d1d78a2f4985 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.873778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.874577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.874861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.875144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.876406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8d73aaed4704c2faee627a52d37a0f8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:46.878208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:46.879755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 168/335] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:46.885853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.900584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab3920-50cd-47b0-a7ef-f6ebfc24cf58 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.907931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.908740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.909020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.909291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] PATH_INFO: `/v3/groups/2b4158259c064b01b49fcea88040760f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.914961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b4158259c064b01b49fcea88040760f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:46.916873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49725-bc9c-41aa-89c0-3d45f6d86a55 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:46.918337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 168/336] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/groups/2b4158259c064b01b49fcea88040760f => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:42:46.924083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:46.933958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f7b05-2b12-4b8c-81bd-4427d7e65fc2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:46.940037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:46.940651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:46.940933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:46.941229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:46.942005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] RBAC: Adding query filter params (group.id=2b4158259c064b01b49fcea88040760f, role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=c8d73aaed4704c2faee627a52d37a0f8) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:46.942306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:46.944139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c9a9-9985-4f0e-b008-4986dfa37535 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:46.949814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 169/337] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:46 2021] GET /identity/v3/role_assignments?group.id=2b4158259c064b01b49fcea88040760f&scope.project.id=c8d73aaed4704c2faee627a52d37a0f8&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:49.012707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84821a-c69f-46a7-96a2-ce30e734b6a9 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.013666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84821a-c69f-46a7-96a2-ce30e734b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.013666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84821a-c69f-46a7-96a2-ce30e734b6a9 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.016289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 169/338] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:49.025158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.025876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.026021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.050263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:49.051400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:49.059059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 170/339] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:49.082996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84821a-c69f-46a7-96a2-ce30e734b6a9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:49.099788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84821a-c69f-46a7-96a2-ce30e734b6a9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:49.104671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:49.105380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.105661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.105936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.117317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:49.123723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:42:49.124854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 170/340] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:42:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:49.131514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:49.140421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2a37a-70d8-492d-a323-05a9f5a00109 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:49.146129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:49.146751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.147039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.147319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.148036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:49.148366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:49.149951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:49.159393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 171/341] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:49.165168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:49.176171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6dd0-4fa4-44f5-8b6c-1ab1a799872f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:49.182277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:49.183045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.183319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.183587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] PATH_INFO: `/v3/groups/2b4158259c064b01b49fcea88040760f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.184922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b4158259c064b01b49fcea88040760f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:49.187127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:49.188604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:49 2021] GET /identity/v3/groups/2b4158259c064b01b49fcea88040760f => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:49.194190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:49.204022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39366a25-6608-4336-baa7-cbe9ff492300 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:49.209010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:49.209812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.210071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.210378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.211521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] RBAC: Authorizing `identity:get_project(project_id=c8d73aaed4704c2faee627a52d37a0f8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:49.213386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba28d7e-9e04-465d-a910-9feeceb40fbd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:49.214958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 172/343] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:49 2021] GET /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:49.220684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:49.230547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf485532-c743-4119-a262-88f2cf4c9a37 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:49.236466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:49.237286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:49.237560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:49.237826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8/groups/2b4158259c064b01b49fcea88040760f/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:49.240044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d73aaed4704c2faee627a52d37a0f8, group_id=2b4158259c064b01b49fcea88040760f, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:49.242695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16141dc5-ae94-4a4e-91a6-5291f1e0c00d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:49.259247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 172/344] 10.222.0.60 () {58 vars in 1463 bytes} [Tue Nov 23 12:42:49 2021] PUT /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8/groups/2b4158259c064b01b49fcea88040760f/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:42:51.324902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51378-70b2-49bd-bb96-357cf5bf30b6 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.325494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51378-70b2-49bd-bb96-357cf5bf30b6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.325494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff51378-70b2-49bd-bb96-357cf5bf30b6 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.327276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 173/345] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:51.332798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.333291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.333398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.357709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:51.358843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:51.430688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:51.455046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff51378-70b2-49bd-bb96-357cf5bf30b6 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.472545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff51378-70b2-49bd-bb96-357cf5bf30b6 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.477933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.478662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.478945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.479222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.493409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:51.499774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:42:51.500929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 174/347] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:51.510533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.520739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1651ab-f78c-4651-89be-da421cfbca73 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.526058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.526647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.526934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.527212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.527932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:51.528230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:51.530211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:51.539765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 174/348] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:51.545815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.560854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0876-dbe1-4213-9c0a-aa5db683c2fc admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.569278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.570106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.570517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.570886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.582184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:51.583911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:51.593196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:51.602218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.614348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211ac0-efb2-440a-a397-ef1a1d308f4e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.619052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.619857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.620139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.620456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.621595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8d73aaed4704c2faee627a52d37a0f8)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:51.623422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:51.624992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 175/350] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:51.631313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.643433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778883c-338f-4ac6-8cf3-e77b431ae833 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.649339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.650129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.650405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.650680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] PATH_INFO: `/v3/groups/2b4158259c064b01b49fcea88040760f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.651988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] RBAC: Authorizing `identity:get_group(group_id=2b4158259c064b01b49fcea88040760f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:51.654318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394992-38b8-44e0-bd6b-1f02e183e8ed admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:51.656044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 176/351] 10.222.0.60 () {56 vars in 1201 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/groups/2b4158259c064b01b49fcea88040760f => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:51.662729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:51.677707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f9f5-07b6-4eaf-91e2-f2512807f274 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:51.683816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:51.684794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:51.685422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:51.685676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:51.686809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] RBAC: Adding query filter params (group.id=2b4158259c064b01b49fcea88040760f, role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=c8d73aaed4704c2faee627a52d37a0f8) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:51.687289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:51.689502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16c42-505a-4d0b-a122-641953ac8433 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:51.696195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 176/352] 10.222.0.60 () {56 vars in 1397 bytes} [Tue Nov 23 12:42:51 2021] GET /identity/v3/role_assignments?group.id=2b4158259c064b01b49fcea88040760f&scope.project.id=c8d73aaed4704c2faee627a52d37a0f8&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:55.103005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2278a-185e-40be-9112-c43b6d94d428 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:55.103560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2278a-185e-40be-9112-c43b6d94d428 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:55.103560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2278a-185e-40be-9112-c43b6d94d428 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:55.105351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 177/353] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:55.111019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:55.111426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:55.111582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:55.134610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:55.135797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:55.143920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 177/354] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:55.169422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2278a-185e-40be-9112-c43b6d94d428 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:55.188802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2278a-185e-40be-9112-c43b6d94d428 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:55.194492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:55.195206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:55.195484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:55.195754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:55.208636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:55.210480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:55.228588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:42:55.229758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 178/355] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:42:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:55.235863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:55.245152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5146aef-aaf5-4b42-8021-a3fb4351f2ea None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:55.250017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:55.250601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:55.250882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:55.251154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:55.251845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:55.252141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:55.253801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e36ad-f448-4784-a73a-deec2980a0b2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:55.267141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 178/356] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:42:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:55.273347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:55.289485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e70cd-363c-4b26-841f-a5e42eebe783 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:55.297149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:55.297748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:55.298030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:55.298302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:55.298977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:55.300002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:55.300002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:42:55.300002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:42:55.301268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b78f-a1f7-4bee-849e-b394f3ff7434 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:55.328800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 179/357] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:42:55 2021] POST /identity/v3/users => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:42:57.439318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921471-a868-49f4-8127-e7d35e4562d2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.439876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921471-a868-49f4-8127-e7d35e4562d2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.439876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921471-a868-49f4-8127-e7d35e4562d2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.441617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 179/358] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:42:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:42:57.447991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.448715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.448969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.480144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:42:57.481363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:42:57.490407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 180/359] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:42:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:42:57.522838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06921471-a868-49f4-8127-e7d35e4562d2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.539031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06921471-a868-49f4-8127-e7d35e4562d2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.544674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.545453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.545743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.546018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.558343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:42:57.564929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:42:57.566091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 180/360] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:57.575333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.589163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa5e94-3f75-4a64-be68-b95ea62f9c08 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.598021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.598979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.599460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.599917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.601161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:57.601651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.604300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.615051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 181/361] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:57.623887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.639955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea78a-5184-44cb-9f4b-5e685c6aba58 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.646184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.646890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.647175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.647448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.661130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.663495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.682089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:42:57.683205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 181/362] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:57.689221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.699854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4017b-2bfc-454d-a30b-4cb8074b8b61 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.705813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.706405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.706684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.706965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.707647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:57.707940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.709009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:57.709009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:42:57.709009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:42:57.709910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.724150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 182/363] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:57.729687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.740390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652e3ad-650a-40f2-a3d6-6ea77c6d0d79 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.746382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.747104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.747387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.747683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.761886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.764031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.783249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:42:57.784381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 182/364] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:57.791073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.803289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0dd-16b7-4d43-9625-e3fe8aabb13f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.808637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.809233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.809512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.809785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.810577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:57.810878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.811878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:57.811878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:42:57.811878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:42:57.813047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.843843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 183/365] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:57.852696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.864655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f0cc-0e3d-4662-99c7-47953b744839 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.870755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.871324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.871607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.871886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.881222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.882973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.892005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 183/366] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:42:57.898114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.910428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f270b6-0ac1-465d-acca-4298c06a7e14 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.916556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.917282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.917561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.917834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.931788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.933721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.952548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:42:57.953574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 184/367] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:57.959521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:57.969147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8556c2-f8d1-4882-940e-27d298aed5c5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:57.975191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:57.975778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:57.976060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:57.976369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:57.977058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:57.977358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:57.978919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:57.992698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 184/368] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:57.999140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:58.009824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319694f-99a6-4ff5-8a55-a8ebbab82d0e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:58.015435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:58.016168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:58.016480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:58.016757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:58.026217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:58.028576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:58.042975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:42:58.044070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 185/369] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:42:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:42:58.051083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:58.064820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277babc-e33c-46e7-ab76-ac21b6304215 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:58.070542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:58.071135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:58.071418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:58.071695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:58.072486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:58.072795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:58.073816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:42:58.073816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:42:58.073816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:42:58.075463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaafd2-38d0-4280-a2c6-a5662b27af9a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:58.089873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:42:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:42:58.096387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:42:58.106371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8bec5-581c-4a5f-9281-6274bc5302a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:42:58.121030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:42:58.121634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:42:58.121913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:42:58.122197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:42:58.123258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:42:58.123643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:42:58.125550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989b3cb-b581-49ad-b3f5-2d8775335e94 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:42:58.132871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:42:58 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.203297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247be-a599-48d1-a6bd-ccc29d7f7752 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.204097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247be-a599-48d1-a6bd-ccc29d7f7752 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.204097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247be-a599-48d1-a6bd-ccc29d7f7752 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.206763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 186/372] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:00.213052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.213790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.213937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.238498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:00.239674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:00.248215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 187/373] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:00.282852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7247be-a599-48d1-a6bd-ccc29d7f7752 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.298129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7247be-a599-48d1-a6bd-ccc29d7f7752 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.304077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.304836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.305128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.305399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.318906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:00.325246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:00.326372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 187/374] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:00.332939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.345597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f5c1-4377-4d2a-b4a1-4f2710d47b8b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.351779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.352400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.352680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.352945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.353655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:00.353950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.355557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.365235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 188/375] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.373880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.385827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245236cf-46fc-4119-a127-ba5dc68965ad admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.391737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.392473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.392751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.393026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.407226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.410131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.436702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:00.437824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 188/376] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:00.443786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.454674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf368d-9583-461a-b170-be2d7d107aba admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.460698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.461316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.461604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.461876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.462581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:00.462878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.464528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.478732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 189/377] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.484606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.494604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9fa5-cb13-40ef-b3e1-6beaade83c38 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.500652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.501379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.501639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.501911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.515424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.517458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.535980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:00.537085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 189/378] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:00.543124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.553421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00c98c-76ea-41ec-9168-71ac9022eb30 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.559502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.560093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.560419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.560699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.561507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:00.561784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.563678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.593058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 190/379] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.598992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.609121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76247-48ff-47eb-8482-f4c04298ac96 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.615308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.616063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.616380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.616657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.629274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.631126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.649014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:00.650135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 190/380] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:00.659917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.673445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650742-d729-408d-8de9-d76d56a65133 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.680311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.681232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.681637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.682084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.683210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:00.683614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.685822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.704131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 191/381] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.711364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.721866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f9e9a-0c4e-4cc4-94d5-5bdf7cd4b316 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.727779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.728527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.728805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.729070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.738869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.741997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.763531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:00.764849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 191/382] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:00.771678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.787373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8db8-cb08-412c-9ecf-bd9bffd11fff admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.795152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.795765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.796053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.796350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.797122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:00.797427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.798428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:00.798428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:00.798428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:00.799563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1571-e813-48cf-b867-9d27f9b38d63 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.813392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 192/383] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:00.819425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:00.829791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4a5f-5a6e-417e-b152-5b458a7c2307 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:00.835069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:00.835913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:00.836188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:00.836491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/852684ea01d74d47b176096f6297c602` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:00.858324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=7ec290df16034659ad193a9b20f7507e, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:00.860993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308196-aec3-411e-8f96-4c064b02b18f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:00.876624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 192/384] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:43:00 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:43:02.935197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e686c-49f5-4187-9608-89b59bf6815a None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:02.936073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e686c-49f5-4187-9608-89b59bf6815a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:02.936073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e686c-49f5-4187-9608-89b59bf6815a None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:02.938967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 193/385] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:02.948017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:02.948692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:02.948990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:02.972960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:02.974117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:03.042050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 193/386] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:03.065485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e686c-49f5-4187-9608-89b59bf6815a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.079522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e686c-49f5-4187-9608-89b59bf6815a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.084599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.085351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.085634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.085913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.097711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:03.104006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:03.105199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 194/387] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:03.111523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.120543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ac25-b3e0-49ae-9ec7-b7da32415113 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.126164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.126767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.127055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.127327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.128053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.128393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.130014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.139884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 194/388] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:43:03.148772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.161861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee38be-35a5-42c3-98a8-d5bdc764ec58 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.167523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.168272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.168575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.168842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.181214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.183058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.206921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:03.208759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 195/389] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:03.217851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.232744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46427-2e9e-4048-9388-1b5b3f220194 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.241212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.241923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.242260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.242609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.243624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.244019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.246525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.261246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 195/390] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:03.269607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.283292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae96644-0045-4ccf-a98c-f02242c591d1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.288810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.289530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.289810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.290090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.303286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.305342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.324045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:03.325157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 196/391] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:03.334218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.347498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934229d-b5d8-4837-95a8-61f4ef5b69a1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.353804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.354321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.354599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.354870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.355647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.355944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.357036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:03.357036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:03.357036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:03.358165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.388416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 196/392] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:03.394085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.404705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e71f72-bec1-445b-96f3-0019453c0db0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.410793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.411362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.411640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.411912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.420197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.421996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.430449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:03.436339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.446226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cd101-aeb4-4b23-962e-97cb82f2ba11 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.452369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.453088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.453364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.453635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.467473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.469335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.488026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:03.489129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 197/394] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:03.494989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.503576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ecb92-e704-4128-a10c-50129eed2695 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.508817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.509391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.509671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.509940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.510621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.510910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.512512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.525936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 198/395] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:43:03.534559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.549366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b0ba-9faa-41cd-a638-f879a38ff33a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.556572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.557231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.557564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.557767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.568726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.570725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.584880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:03.585996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 198/396] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:03.592633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.603088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9c978-09a6-4261-aca2-2ee3cdac7126 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.608881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.609411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.609701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.609978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.610736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.611038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.612918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33542c7-2657-41a3-b05e-418861559c25 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.627171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 199/397] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:03.633561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:03.643605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995ed5-916e-4dfe-b99f-438e8164145b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:03.649590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:03.650180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:03.650457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:03.650734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:03.651505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:03.651802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:03.654232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dccec-e4eb-4f8b-b56f-7aa0957d5300 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:03.660564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 199/398] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:03 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:05.765066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda842-b370-426f-8012-7d53270b1443 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:05.765938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda842-b370-426f-8012-7d53270b1443 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:05.765938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda842-b370-426f-8012-7d53270b1443 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:05.768037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 200/399] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:05.775900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:05.776395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:05.776507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:05.805490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:05.806633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:05.813748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 200/400] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:05.837116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eda842-b370-426f-8012-7d53270b1443 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:05.850315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eda842-b370-426f-8012-7d53270b1443 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:05.854935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:05.855686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:05.855959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:05.856252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:05.867358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:05.873599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:43:05.874688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 201/401] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:43:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:05.881402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:05.893253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd11c41-dc5c-4920-a1c3-10ed3f0fb9dc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:05.897757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:05.898346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:05.898628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:05.898908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:05.899615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:05.899911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:05.901560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:05.910950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 201/402] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:05.916765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:05.929027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacff88-43c5-40e2-9a6e-0ac01987a4fb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:05.933372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:05.934089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:05.934374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:05.934651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:05.946490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:05.948378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.064147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:06.065323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 202/403] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:06.071606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.081490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051939ea-8932-48a5-80a0-e81cd431d99e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.086051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.086633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.086909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.087189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.087874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:06.088173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.089820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.102716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 202/404] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:06.108667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.119062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428eb3-2f73-4668-b7da-6b6a0fca7e42 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.124767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.125500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.125785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.126057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.140486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.142562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.161390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:06.162502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 203/405] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:06.171785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.187419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f550-a1e1-4b0c-bbb9-245a43d18e56 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.193459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.194049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.194372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.194620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.195433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:06.195723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.197610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.228222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 203/406] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:06.234970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.249928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638be09d-bbe0-47b9-b9d9-2bb42b29a59f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.255331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.255906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.256222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.256583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.265582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.267387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.277158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:06.284098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.294611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147945-e8b3-48f4-9739-64f8d41f8959 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.300169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.300909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.301189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.301465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.314362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.316111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.341615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:06.343088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 204/408] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:06.351795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.362297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bd1-deae-44ef-b75c-f5bf2e55bf8a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.371355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.372296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.372741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.373296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.373942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:06.374239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.375853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.389852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 205/409] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:06.398640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.409555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee5c1-219b-4b25-bfb4-283dac6e69ca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.414995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.415707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.415989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.416275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.429371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.432875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.458123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:06.460087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 205/410] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:06.468973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.479578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab255966-b077-4141-a83b-f68be25847e1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.485051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.485643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.485923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.486197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.486950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:06.487245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.489163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e621a-03df-45b2-8c82-4a1f399771c4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.505193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 206/411] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:06.512361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:06.524178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85b18-b266-4be1-83b1-86b9562ba896 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:06.530318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:06.530861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:06.531117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:06.531397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:06.532329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:06.532556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:06.534452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef58294-3d86-4931-b5d8-14cbfb27dc0c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:06.540798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 206/412] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:06 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:08.774568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8eb5-172e-47f6-a6b2-887eb5c86d10 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:08.775174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8eb5-172e-47f6-a6b2-887eb5c86d10 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:08.775174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8eb5-172e-47f6-a6b2-887eb5c86d10 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:08.776818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 207/413] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:08.782811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:08.783260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:08.783368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:08.807559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:08.808744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:08.817411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 207/414] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:08.839887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8eb5-172e-47f6-a6b2-887eb5c86d10 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:08.855227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8eb5-172e-47f6-a6b2-887eb5c86d10 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:08.860853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:08.861597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:08.861883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:08.862153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:08.875214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:08.881463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:43:08.882581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 208/415] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:43:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:08.889412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:08.904379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e58f4-7dfe-4639-9a42-dcc182df34ed None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:08.913521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:08.914450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:08.914916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:08.915377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:08.916557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:08.917053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:08.919604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:08.929057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 208/416] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:08.937685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:08.948390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cd3e-a150-40a6-9a28-23240b9d54cf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:08.953504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:08.954216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:08.954503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:08.954777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:08.967452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:08.969323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:08.987611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:08.988695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 209/417] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:08.994460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.004686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b1350-fe57-4247-bbcc-453be638e4f2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.009385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.009968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.010249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.010544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.011239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:09.011533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.013188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.027648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 209/418] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:09.034345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.048900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e4fbd-7c60-4deb-88c8-eb3fb930dd76 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.056060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.057126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.057521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.057912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.078990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.081057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.099127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:09.100220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 210/419] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:09.106415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.116593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9c663-8406-4b34-943b-6a31fec7f3fa admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.122029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.122622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.122965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.123237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.124156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:09.124495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.126384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.157997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 210/420] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:09.166915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.183365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b2a-6262-4ba7-92db-be1d38bb1c9a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.189620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.190340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.190622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.190895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.203697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.205566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.223186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:09.224276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 211/421] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:09.230875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.247017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cba03-0eef-49a8-949a-d5f6d8645003 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.253364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.253948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.254231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.254508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.255197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:09.255492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.257120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.269793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 211/422] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:09.275431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.286353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ea60d-50f1-4755-9698-0e6e53d1acf7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.292038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.292779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.293057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.293329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.302489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.304488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.318830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:09.319899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 212/423] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:09.326053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.339803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ec48-04a0-44d9-be2a-d5f6494b7da2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.346212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.346790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.347070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.347344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.348079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:09.348393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.350253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32aaaf4-2752-4a3f-8141-0d1521ba7fef admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.365734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 212/424] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:09.372993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:09.383018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb913c8-4e9d-4675-83d0-d8caf486fe21 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:09.388846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:09.389813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:09.390090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:09.390486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:09.392640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=7ec290df16034659ad193a9b20f7507e, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:09.395259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b12589-ef8b-4036-bfae-01f1876ca884 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:09.413631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 213/425] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:43:09 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:43:11.973721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599f47-442a-43f5-be4c-72612f6e6009 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:11.974341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599f47-442a-43f5-be4c-72612f6e6009 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:11.974341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599f47-442a-43f5-be4c-72612f6e6009 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:11.975949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 213/426] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:11.982512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:11.983248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:11.983345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.018453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:12.019657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:12.092870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 214/427] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:12.118327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc599f47-442a-43f5-be4c-72612f6e6009 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.136367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc599f47-442a-43f5-be4c-72612f6e6009 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.142967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.144568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.145282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.145850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.163582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:12.171830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:43:12.173988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 214/428] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:12.182078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.195230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04424553-8469-49b3-8c3d-be257f476c7a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.202036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.202709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.202988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.203225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.204005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.204344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.206378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.219209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 215/429] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:12.227595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.244310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeab5f-4346-4f6a-b239-55f63c496a70 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.251216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.251953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.252252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.252543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.264613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.266458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.284450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:12.285560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 215/430] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:12.291438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.302387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca950-96b4-48bf-91db-5911fec74e92 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.307211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.307767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.308060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.308369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.309065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.309361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.311258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.325714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 216/431] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:12.331502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.341773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1afeb-74b2-43d1-bae5-537a4572745e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.347541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.348266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.348561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.348837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.362689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.364765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.383408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:12.384494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 216/432] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:12.390398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.400000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b124b-e0ff-4c97-a906-587f93d7d833 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.405127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.405717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.405997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.406274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.407054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.407350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.409236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.445737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 217/433] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:12.452810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.471385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755e2e7-b2bb-4214-8f97-64d6ee36a059 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.477881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.478557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.478837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.479106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.488217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.489976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.498775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 217/434] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:12.504700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.514819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e945ec1-7fa0-465d-bfce-449cf871d6ec admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.520701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.521447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.521732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.522006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.534940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.536847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.554041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:12.555178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 218/435] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:12.566087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.575556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6ef09-744d-4084-9794-828ee3841703 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.582186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.582777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.583064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.583339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.584042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.584374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.586379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.604690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 218/436] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:12.611212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.621106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222520-8fef-401d-9b6c-fdfe0c7d78e0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.626217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.626921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.627196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.627419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.636261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.638141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.652349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:12.653738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 219/437] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:12.659701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.669942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a09e8-5f61-49ff-acdb-c79b5c414b46 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.675173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.675731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.676009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.676348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.677029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.677322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.679132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f9179-a19e-4ac9-839f-ccf1f6a8641a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.696561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 219/438] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:12.703942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:12.713964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29653a7-aa9a-4b05-8e36-3dceaf7aa6da admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:12.719885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:12.720504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:12.720785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:12.721062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:12.721911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:12.722137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:12.723997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b0d50-c652-4ad9-ba52-7d11aa60f3a6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:12.730039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 220/439] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:12 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:14.822027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c96-2e5d-4d93-9c62-2835ce0ea42a None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:14.822876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c96-2e5d-4d93-9c62-2835ce0ea42a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:14.822876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2c96-2e5d-4d93-9c62-2835ce0ea42a None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:14.824746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 220/440] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:14.830737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:14.831225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:14.831327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:14.855121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:14.856265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:14.863901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 221/441] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:14.885861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2c96-2e5d-4d93-9c62-2835ce0ea42a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:14.900114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2c96-2e5d-4d93-9c62-2835ce0ea42a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:14.905705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:14.906432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:14.906713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:14.906988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:14.907611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:14.908666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:14.908666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:14.908666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:14.909540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:14.920996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 12:43:14.922039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 221/442] 10.222.0.60 () {56 vars in 1153 bytes} [Tue Nov 23 12:43:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:14.928351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:14.937430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa5eb4-a2bf-4ff5-97af-fefae83db8e7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:14.942785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:14.943365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:14.943648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:14.943922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:14.944643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:14.944950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:14.945973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:14.945973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:14.945973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:14.946836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393a5c-b81d-4764-898b-a6cb6b9b43f3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:14.951321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 222/443] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:14.959581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:14.974375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d8665-f014-4476-b767-ac8ea1eb0d1d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:14.982550 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:14.983131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:14.983408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:14.983688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:14.984382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:14.984676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:14.985674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:14.985674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:14.985674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:14.986554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770e6f-b2f3-4c65-b500-de1b8c2d8e31 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:14.991496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 222/444] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:14 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:17.054007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb3f1-fb5d-40ab-a177-f64bbf158df5 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:17.054568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb3f1-fb5d-40ab-a177-f64bbf158df5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:17.054568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbb3f1-fb5d-40ab-a177-f64bbf158df5 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:17.057314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 223/445] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:17.066415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f033f-bb4f-475f-9e0d-ed41f266a60a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:17.066825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f033f-bb4f-475f-9e0d-ed41f266a60a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:17.067003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f033f-bb4f-475f-9e0d-ed41f266a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:17.094229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c52f033f-bb4f-475f-9e0d-ed41f266a60a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:17.095292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c52f033f-bb4f-475f-9e0d-ed41f266a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:17.102922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 223/446] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:17.125981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbb3f1-fb5d-40ab-a177-f64bbf158df5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:17.139729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbb3f1-fb5d-40ab-a177-f64bbf158df5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:17.144863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:17.145448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:17.145726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:17.145996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:17.146681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:17.147719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:17.147719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:17.147719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:17.148684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581d681-f048-4110-b998-fc2e487e0df8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:17.167503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 224/447] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:43:17 2021] POST /identity/v3/services => generated 269 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:19.236126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb359e-afb1-4ca5-8888-88b21f5cc29c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.237049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb359e-afb1-4ca5-8888-88b21f5cc29c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.237049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb359e-afb1-4ca5-8888-88b21f5cc29c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.239616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 224/448] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:19.245986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.246416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.246595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.275761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:19.276946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:19.295949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 225/449] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:19 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:19.331469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb359e-afb1-4ca5-8888-88b21f5cc29c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:19.346365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb359e-afb1-4ca5-8888-88b21f5cc29c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:19.352188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:19.352972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.353260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.353537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.354149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:19.355769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:19.367763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 12:43:19.368895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 225/450] 10.222.0.60 () {56 vars in 1153 bytes} [Tue Nov 23 12:43:19 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:19.375744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:19.389318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757a34b-481a-4fd0-885f-769eeb943f4f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:19.395383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:19.395974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.396269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.396561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.397233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:19.397524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:19.399140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:19.404705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 226/451] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:19 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:19.410314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:19.420253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7822-e780-45cf-bbca-77803c0f60af admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:19.425001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:19.425615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.425906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.426198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.426879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:19.427178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:19.428847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:19.433634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 226/452] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:19 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:19.439279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:19.449111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972086f-ec04-4d2b-975d-c26bf6863b54 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:19.465062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:19.465931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.466286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.466696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.467758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] RBAC: Adding query filter params (interface=public, service_id=663ba6d5b87042afbdd2cca63ed58ba9, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:19.468155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:19.469706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:19.469706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:19.469706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:19.471070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cfc4-ec65-4189-a11e-583d07ad12ea admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:19.480837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 227/453] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:43:19 2021] GET /identity/v3/endpoints?service_id=663ba6d5b87042afbdd2cca63ed58ba9&interface=public®ion_id=RegionOne => generated 194 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:19.486955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:19.497434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0b71-6dff-4b15-a7c8-4be545e2e5ca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:19.503649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:19.504255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:19.504558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:19.504827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:19.505474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:19.507056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d45ed-b76e-4c50-b273-fb25edb81d41 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:19.512263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 227/454] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:43:19 2021] GET /identity/v3/services => generated 562 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:21.578051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14be4-acd4-496e-9b75-7b77eae4b0f8 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.578968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14be4-acd4-496e-9b75-7b77eae4b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.578968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14be4-acd4-496e-9b75-7b77eae4b0f8 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.581633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 228/455] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:21.587684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.588123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.588326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.619363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:21.620579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:21.630038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 228/456] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:21 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:21.656637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14be4-acd4-496e-9b75-7b77eae4b0f8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:21.672418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14be4-acd4-496e-9b75-7b77eae4b0f8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:21.677932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:21.678699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.678979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.679239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.679890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:21.680943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:21.680943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:21.680943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:21.681823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:21.694551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 12:43:21.695714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 229/457] 10.222.0.60 () {56 vars in 1153 bytes} [Tue Nov 23 12:43:21 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:21.702722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:21.717104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3b92c-e19d-4b73-8e67-67d56aa56285 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:21.724684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:21.725278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.725555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.725830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.727588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:21.728440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:21.731091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:21.737070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 229/458] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:21 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:21.743045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:21.753631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71badf4f-b8e4-49c5-8021-c619b3f285fe admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:21.759551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:21.760135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.760441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.760718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.761384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:21.761658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:21.763338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e9900-7fed-49b6-9a20-900c271ed376 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:21.768396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 230/459] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:43:21 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:21.776059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:21.786785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7e85-44c4-4896-b613-a32bab5b5c78 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:21.791821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:21.792468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:21.792754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:21.793024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:21.793701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:21.794738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:21.794738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:21.794738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:21.795595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b13e-f9f3-4153-a989-14d26ab9d537 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:21.816991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 230/460] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:43:21 2021] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:23.907377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a25a-b216-43d9-8686-eea03c0fcaa6 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:23.908299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a25a-b216-43d9-8686-eea03c0fcaa6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:23.908299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a25a-b216-43d9-8686-eea03c0fcaa6 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:23.910818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 231/461] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:23.916418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:23.916920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:23.917014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:23.941717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:23.942866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:23.966608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:23 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:23.993132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a25a-b216-43d9-8686-eea03c0fcaa6 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:24.006667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a25a-b216-43d9-8686-eea03c0fcaa6 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:24.011077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:24.011797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:24.012081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:24.012400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:24.013067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:24.014713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:24.025431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 12:43:24.026581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 232/463] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:24.033297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:24.042183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ff4b-2b35-4832-98ae-d9bbb58d6c23 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:24.046878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:24.047462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:24.047732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:24.048003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:24.048707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:24.049007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:24.050629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50343-b5bd-477e-897d-330f4eaffdce admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:24.055314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 232/464] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:24 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:24.061047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:24.071510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd660-6bb7-4ff1-95d7-d941058d7adb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:24.076087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:24.076724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:24.077007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:24.077284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:24.077965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:24.078263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:24.079914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b5b3-c191-43a1-9ec6-72658277dc04 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:24.084629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 233/465] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:24 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:26.162280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3972-447e-4657-85bd-76056a4cbeae None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:26.162805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3972-447e-4657-85bd-76056a4cbeae None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:26.162805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e3972-447e-4657-85bd-76056a4cbeae None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:26.164414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 233/466] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:26.170497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba772-a23f-4e3b-9df8-7a1c4551be59 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:26.170969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba772-a23f-4e3b-9df8-7a1c4551be59 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:26.171058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba772-a23f-4e3b-9df8-7a1c4551be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:26.204726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-978ba772-a23f-4e3b-9df8-7a1c4551be59 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:26.205900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-978ba772-a23f-4e3b-9df8-7a1c4551be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:26.214885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 234/467] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:26 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:43:26.237404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e3972-447e-4657-85bd-76056a4cbeae None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:26.251726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e3972-447e-4657-85bd-76056a4cbeae None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:26.256921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:26.257503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:26.257784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:26.258064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:26.258740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:26.259744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:26.259744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:26.259744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:26.260657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d4fe7-cf81-4c5c-809b-35e486603f9a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:26.277063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 234/468] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:43:26 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:28.364485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16794c-0934-4b38-b12b-9981f4ea2c43 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.365333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16794c-0934-4b38-b12b-9981f4ea2c43 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.365333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16794c-0934-4b38-b12b-9981f4ea2c43 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.369062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 235/469] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:28.376135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.376634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.376720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.401657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:28.403127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:28.421831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 235/470] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:28 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:28.444547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16794c-0934-4b38-b12b-9981f4ea2c43 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:28.459524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16794c-0934-4b38-b12b-9981f4ea2c43 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:28.465293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:28.466069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.466372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.466663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.467287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:28.468949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:28.479436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 12:43:28.480572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 236/471] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:28.487121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:28.495976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031884-f5c7-4e7d-aba9-e3fde79bb311 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:28.501554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:28.502159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.502453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.502712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.503403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:28.503702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:28.505383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:28.510697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 236/472] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:43:28.518846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:28.532870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c1732-a176-49d3-a1d2-e6845cd8cbdf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:28.539058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:28.539657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.539941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.540214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.540920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:28.541222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:28.542889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:28.548389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 237/473] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:28.555285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:28.567609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553b52-c992-46f4-944e-45631cabab75 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:28.573023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:28.573589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.573867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.574139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.574901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] RBAC: Adding query filter params (interface=public, service_id=582c3307116c415f8f062e0a6a085380, region_id=RegionOne) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:28.575198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:28.576506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:28.576506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:43:28.576506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:43:28.577393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334730-ca0c-4aab-9f46-147443e53206 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:28.583526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 237/474] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:43:28 2021] GET /identity/v3/endpoints?service_id=582c3307116c415f8f062e0a6a085380&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:28.589050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:28.599592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe8e6d-0c0d-4078-be6e-1e7e8120c0af admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:28.605069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:28.605672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:28.605962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:28.606240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:28.606871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:28.608529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8550c-99ac-4069-acb7-0282b7a80269 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:28.613811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 238/475] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:43:28 2021] GET /identity/v3/services => generated 792 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:30.686206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca35ab-e24e-4a15-9c34-fa0d2d4d7a3e None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.686769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca35ab-e24e-4a15-9c34-fa0d2d4d7a3e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.686769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca35ab-e24e-4a15-9c34-fa0d2d4d7a3e None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.688531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 238/476] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:30.694018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.694467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.694555 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.718716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:30.719921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:30.728217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 239/477] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:30 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:30.751508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca35ab-e24e-4a15-9c34-fa0d2d4d7a3e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:30.773069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca35ab-e24e-4a15-9c34-fa0d2d4d7a3e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:30.781029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:30.784958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.784958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.784958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.784958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:30.784958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:30.795057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 12:43:30.796154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 239/478] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:30.802382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:30.811730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8f9d-b629-43af-99d9-3f67e74f597d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:30.817230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:30.817892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.818234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.818572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.819300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:30.819678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:30.821288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:30.826499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:30.832021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:30.843097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f18e9-4c3c-44d6-8ced-412dbd1d0429 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:30.848511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:30.849130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.849409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.849679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.850348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:30.850648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:30.852267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cebfb-2353-4252-a016-1e8758a9527b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:30.857547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 240/480] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:43:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:30.863220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:30.873406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b822f-3418-4bb9-b161-b242ea328e12 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:30.880641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:30.881421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:30.881774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:30.882115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:30.883094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:30.884661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:43:30.884661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:43:30.884661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:43:30.885863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30515-cab9-4b3c-8fc9-f4232d1ef65f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:30.914494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 241/481] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:43:30 2021] POST /identity/v3/endpoints => generated 334 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:33.076850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1db6-3d5a-4a46-9567-2ebb1e8c1fdd None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.077397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1db6-3d5a-4a46-9567-2ebb1e8c1fdd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.077397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1db6-3d5a-4a46-9567-2ebb1e8c1fdd None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.079094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 241/482] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:33.085410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.085873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.085963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.111747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:33.112849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:33.131785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 242/483] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:33 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:33.163982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1db6-3d5a-4a46-9567-2ebb1e8c1fdd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.178750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1db6-3d5a-4a46-9567-2ebb1e8c1fdd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.184787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.185522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.185805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.186078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.200054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:33.206774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:43:33.207903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 242/484] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:33.217112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.231744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181a6b-8549-49fc-bc88-0c08b3841290 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.237357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.237956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.238240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.238515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.239239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.239538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.241190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.250093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 243/485] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:33.255753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.265720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99095ac-5328-4925-87c1-a4e0228a3305 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.271151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.271859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.272134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.272439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.286211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.288039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.306581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:33.307691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 243/486] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:33.314216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.328449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920a23-2576-4af7-a14d-cfa55cca8bd0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.334778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.335364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.335647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.335924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.336648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.336947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.338551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.353515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 244/487] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:33.359277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.369361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b9f61-a678-4f82-8355-35c6f69dd3c7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.374537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.375237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.375516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.375790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.390538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.392589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.410881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:33.411994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 244/488] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:33.418286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.434350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ec3f5-731e-493b-aac9-0920b2a8e628 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.443252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.444180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.444703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.445164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.446409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.446901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.449884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.478764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 245/489] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:33.487604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.503251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb86766-7e73-46d7-80ca-01661d1d8812 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.511828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.512792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.513252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.513576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.521838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.523575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.532818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 245/490] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:33.539035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.553236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6f2c-ac57-47c0-9539-22be0c204642 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.559393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.560476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.560758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.561030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.573405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.575268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.592959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:33.594030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 246/491] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:33.603041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.617204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371beb3b-0443-45d8-8afc-4d51fe2f47e2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.624730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.625244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.625520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.625795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.626481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.626778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.628372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.641281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 246/492] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:33.646821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.657775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323185e-2cc3-48e2-baa9-7f33a940c4a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.663184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.663891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.664167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.664462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.673566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.675516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.689795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:33.690904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 247/493] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:33.699786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.714760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9ce31-3a87-473b-912f-50acee03f0d6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.721461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.722037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.722315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.722564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.723338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.723638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.725581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28814317-5e64-43a4-9732-f3270e5d62a1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.739278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 247/494] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:33.746008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:33.756423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f6f7-388d-40e7-896f-21f01c116353 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:33.761887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:33.762427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:33.762726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:33.762996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:33.763770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] RBAC: Adding query filter params (role.id=28dd13be26e84a85b92ffc3e197714c4, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:33.764066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:33.765932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e698cab-f83e-4b1a-86f2-da9aceea6916 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:33.771369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 248/495] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:33 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=28dd13be26e84a85b92ffc3e197714c4 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:35.818500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08b8b-1172-4ee5-bbec-286808467f20 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:35.819010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08b8b-1172-4ee5-bbec-286808467f20 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:35.819010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe08b8b-1172-4ee5-bbec-286808467f20 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:35.820726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 248/496] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:35.826417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:35.826796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:35.826968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:35.859431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:35.860653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:35.872498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 249/497] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:35 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:35.895233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08b8b-1172-4ee5-bbec-286808467f20 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:35.912087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe08b8b-1172-4ee5-bbec-286808467f20 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:35.917158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:35.917900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:35.918184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:35.918468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:35.930463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:35.937219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:43:35.938310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 249/498] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:43:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:35.947874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:35.963185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f655-2575-449b-af18-7d0c1c15f8fe None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:35.970041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:35.970668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:35.970941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:35.971220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:35.971948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:35.972270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:35.973889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:35.982844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 250/499] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:43:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:35.989161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.004001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec87b9c-2489-4b31-a68a-542d67660fa9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.012219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.013318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.014006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.014410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.032397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.034539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.054009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:36.055158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 250/500] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:36.064869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.080198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165f722-c49a-40cd-a13d-6b3b5516dba6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.088661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.089492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.089809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.090130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.091186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:36.091486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.093131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.106474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 251/501] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:36.112737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.122953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76dd86-d38a-4fb8-82b1-71196476abe5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.128547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.129296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.129578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.129857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.143626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.146215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.168245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:36.169415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 251/502] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:36.179046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.191416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae03c-44d9-4c98-bb8b-a883d9db5ed3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.196807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.197415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.197694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.197964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.198749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:36.199058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.201044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.233639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 252/503] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:36.241923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.252489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098de22-2aaa-47aa-a717-3299feb84975 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.258716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.259427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.259704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.259975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.272970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.274802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.292480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:36.293562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 252/504] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:36.302583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.318192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed6d2-bb91-4a6c-9d32-58abd566c008 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.325692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.326253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.326562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.326840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.327527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:36.327827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.329460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.342175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 253/505] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:36.350830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.362861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7d32-a44a-4272-b95b-e9af355dc3f8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.368437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.369159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.369446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.369713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.378997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.380996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.395026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:36.396113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 253/506] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:36.404590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.414699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691472-b2d2-4b1a-9dbf-c9bf37f1d00b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.420273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.420904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.421288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.421451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.422212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:36.422515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.424412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71b5f-30c5-4096-8fd7-db5d7aa01e83 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.437316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 254/507] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:36.443317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:36.453300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be475a-c594-4423-84b8-667d8b6b54ca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:36.459412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:36.460217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:36.460522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:36.460794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/28dd13be26e84a85b92ffc3e197714c4` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:36.463459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=7ec290df16034659ad193a9b20f7507e, role_id=28dd13be26e84a85b92ffc3e197714c4)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:36.466192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7b28f-cbe6-4679-b2fc-14ba76988984 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:36.480949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 254/508] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:43:36 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/7ec290df16034659ad193a9b20f7507e/roles/28dd13be26e84a85b92ffc3e197714c4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:43:38.542588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80e12-8321-4693-a2d3-805d34ac03e4 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.543437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80e12-8321-4693-a2d3-805d34ac03e4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.543437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80e12-8321-4693-a2d3-805d34ac03e4 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.545437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 255/509] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:38.550865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.551282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.551392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.574832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:38.576120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:38.645212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 255/510] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:38 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:43:38.669205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf80e12-8321-4693-a2d3-805d34ac03e4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.683464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf80e12-8321-4693-a2d3-805d34ac03e4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.688573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.689305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.689590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.689867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.701871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:38.708794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:43:38.709926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 256/511] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:38.719512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.733275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aca8ff-8d20-43e0-9f4c-2fd1f7b03289 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.738302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.738902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.739181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.739464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.740197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:38.740518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:38.742119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:38.751413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 256/512] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:38.757286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.768506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08687634-25f6-4614-a2a9-55598f1918fb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.773602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.774329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.774623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.774991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.788492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:38.790391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:38.809294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:38.810417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 257/513] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:38.816500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.827216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-d31d-4072-a490-bcc757c0ae6c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.832747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.833335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.833620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.833896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.834594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:38.834876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:38.836495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:38.850399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 257/514] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:38.856863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.872368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7d19c-e33f-4452-909d-c60860c37387 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.877843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.878560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.878854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.879129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.898959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:38.901056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:38.919776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 12:43:38.920887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 258/515] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:38.929969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:38.941435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c8ca-5da7-4bd5-afe3-fda8432308fc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:38.947480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:38.948062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:38.948372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:38.948645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:38.949430 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:38.949691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:38.951555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.077574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 258/516] 10.222.0.60 () {56 vars in 1154 bytes} [Tue Nov 23 12:43:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:39.083940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.096850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110ef7-3da6-4938-a049-945aeda1e7ec admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.102468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.103049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.103343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.103615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.112116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.113922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.122550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 259/517] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:39.128481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.138882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7914200-0f60-4f57-a761-4db1b2cba8d6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.144340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.145045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.145331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.145599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.159236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.161099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.186305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:39.187426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 259/518] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:39.193929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.206058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce28b3-3306-4207-91eb-5d31f7807185 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.211976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.212608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.212897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.213175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.213862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:39.214156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.215983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.230336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 260/519] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:39.237036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.252024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adc8b-804d-41ab-9d3a-4b1781c5ed77 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.259630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.260689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.261132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.261529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.274510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.276505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.293838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:39.295113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 260/520] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:39.301438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.311999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bceb0-3545-4e16-8b54-fcc7083ac148 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.317389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.317973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.318255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.318532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.319275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:39.319572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.321462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc259d9-ed6c-4a55-9d53-c48ca9ada0d9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.334836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 261/521] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:39.343985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:39.358380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77a5b-3288-4043-ba3e-1042b8828180 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:39.363562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:39.364131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:39.364441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:39.364715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:39.365504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] RBAC: Adding query filter params (role.id=28dd13be26e84a85b92ffc3e197714c4, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=7ec290df16034659ad193a9b20f7507e) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:39.365801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:39.367669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b089e1a-0153-4324-89ea-0ea54c731039 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:39.373661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 261/522] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:39 2021] GET /identity/v3/role_assignments?user.id=7ec290df16034659ad193a9b20f7507e&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=28dd13be26e84a85b92ffc3e197714c4 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:41.653479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606693-9099-41b7-9815-1e7ce55743e5 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:41.654328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606693-9099-41b7-9815-1e7ce55743e5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:41.654328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35606693-9099-41b7-9815-1e7ce55743e5 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:41.656936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 262/523] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:41.666306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:41.666742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:41.666881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:41.691955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:41.693212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:41.701338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 262/524] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:41 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:41.737168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35606693-9099-41b7-9815-1e7ce55743e5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:41.751854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35606693-9099-41b7-9815-1e7ce55743e5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:41.756943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:41.757658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:41.757946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:41.758205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:41.769958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:41.771788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:41.788777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:41.789861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 263/525] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:41.796269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:41.805198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae64c-d98b-419c-ba9d-f0bf56cfa429 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:41.810557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:41.811144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:41.811517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:41.811796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:41.812525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:41.812821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:41.814429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490a2c6-b743-46b7-8df7-b5328ca5bd43 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:41.827530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 263/526] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:41.833288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:41.845319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52126ad-352e-4d8e-b0b7-59fa9b1c962f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:41.851110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:41.851704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:41.851992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:41.852271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:41.852952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:41.854861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5519-4fb7-4209-863b-48256d911b40 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:41.888596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 264/527] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:43:41 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:44.014522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f436-cf0b-463e-863f-2e0d6c236625 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.015365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f436-cf0b-463e-863f-2e0d6c236625 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.015365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f436-cf0b-463e-863f-2e0d6c236625 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.018100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 264/528] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:44.026716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.027785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.027964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.058243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:44.059635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:44.070142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 265/529] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:44 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:44.098255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f436-cf0b-463e-863f-2e0d6c236625 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.111558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f436-cf0b-463e-863f-2e0d6c236625 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.116910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.117629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.117906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.118185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.131709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:44.138514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:44.139727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 265/530] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:44.149578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.160462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e30e2f-a84d-4694-a49b-f69dd15f264f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.166041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.166647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.166931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.167216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.167928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.168265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.170070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.179181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 266/531] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:44.185940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.199628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d631bd-405a-4311-9a2a-43fe1db739fe admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.208427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.209584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.210051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.210504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.225679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.227527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.246009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:44.247162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 266/532] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:44.256495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.271834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a836-d309-4d0b-bcee-d1b4622c9c7d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.280483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.281074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.281361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.281631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.282345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.282643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.284219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.298186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 267/533] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:44.304562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.316949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1db2-4bd1-4fa2-a7ee-51a011487988 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.323145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.323873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.324152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.324469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.338571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.340650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.359486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 12:43:44.360554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 267/534] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:44.369571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.381106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e8faf-6f75-400e-8149-b70751ac82e5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.388550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.389182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.389463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.389741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.390528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.390827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.392734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.423184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 268/535] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:44.429963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.442230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcf6cf-f948-4e24-8378-1737371ba61c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.448726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.449299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.449578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.449919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.458148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.459886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.469517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 268/536] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:44.476106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.488897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9f7b4-affa-4197-969d-06a0c0224241 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.496310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.497375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.497840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.498283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.516050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.518086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.537091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:44.538224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 269/537] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:44.544270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.553893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868562a8-ef1e-44b8-a2ae-0fc28eed43a8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.560168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.560807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.561088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.561362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.562054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.562360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.563944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.578086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 269/538] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:44.584200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.599501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d557a9-2695-4660-8d26-12dad1c91a56 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.607548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.608329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.608608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.608882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.618197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.620160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.633971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:44.635023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 270/539] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:44.642872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.658521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ffb90-f96f-4f97-bcd3-4bd174d586b7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.666736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.667709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.668060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.668949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.669704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.670006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.671842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce3d0-7cf7-4abe-880a-bf1fbf5e9fd3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.684693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 270/540] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:44.690956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:44.701093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c066-770c-4913-9462-4473705e21be admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:44.706696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:44.707262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:44.707542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:44.707821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:44.708636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=6ba29c5b041e431ca8660c2d2ca8aee3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:44.708960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:44.710788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ec09-0971-40e8-8322-ffb5c62639b9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:44.716501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 271/541] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:44 2021] GET /identity/v3/role_assignments?user.id=6ba29c5b041e431ca8660c2d2ca8aee3&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:46.804530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c00a-59ba-47f8-8834-b6adcf9a7203 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:46.805310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c00a-59ba-47f8-8834-b6adcf9a7203 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:46.805310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c00a-59ba-47f8-8834-b6adcf9a7203 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:46.808194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 271/542] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:46.816470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:46.816931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:46.817087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:46.843544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:46.844822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:46.854741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 272/543] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:46 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:46.888775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c00a-59ba-47f8-8834-b6adcf9a7203 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:46.904327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c00a-59ba-47f8-8834-b6adcf9a7203 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:46.910263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:46.910981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:46.911263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:46.911542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:46.924296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:46.930610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:46.931745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 272/544] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:46.938045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:46.947757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e07c-634e-4e02-ac3f-ac992e1b79a7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:46.954001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:46.954597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:46.954877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:46.955152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:46.955881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:46.956178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:46.957841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:46.967179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 273/545] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:46.972731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:46.983442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438bfd-ad76-4b03-be2b-75dcca5d2193 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:46.988536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:46.988939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:46.989227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:46.989503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.001448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.003257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.021173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:47.022238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 273/546] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:47.029068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.044524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a8b78-a62f-444c-9db6-d4ce3d2aaa51 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.049047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.049627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.049909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.050182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.050861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:47.051156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.052833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.067411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 274/547] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:47.076869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.091967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb038-4082-48fc-b5dc-1f1506ce42b1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.097538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.098256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.098509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.098823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.113591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.115642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.134088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 12:43:47.135281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 274/548] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:47.142392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.157489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2efb-1e20-4ea9-a934-a385969435ed admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.163508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.164097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.164421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.164694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.165496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:47.165793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.167655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.197729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 275/549] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:47.204619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.218948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d40b-f9b5-4f43-85a6-2776abfb715d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.223724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.224457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.224740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.225013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.237305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.239150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.256103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:47.257222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 275/550] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:47.263088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.277176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16950b-40af-429a-be30-b3749fb70dbf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.283335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.283930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.284209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.284519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.285221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:47.285518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.287117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.300945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 276/551] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:47.306717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.317166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fa657-0fd3-4d12-bab6-783b7a617fe0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.323068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.323725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.324005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.324271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.333967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.335909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.350412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:47.351477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 276/552] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:47.358123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.373387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0167a3-5495-44bc-850d-e3667443e6d6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.378947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.379537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.379843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.380096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.380885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:47.381192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.383042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2c45-8398-42ee-b1ea-077dd18747c2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.397163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 277/553] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:47.405606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:47.415840 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828bdc-7402-438f-999c-3c106da39c74 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:47.421475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:47.422347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:47.422635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:47.422912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/6ba29c5b041e431ca8660c2d2ca8aee3/roles/852684ea01d74d47b176096f6297c602` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:47.444269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=6ba29c5b041e431ca8660c2d2ca8aee3, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:47.446929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8e1d9-0255-462b-9c70-392c382740ee admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:47.465668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 277/554] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:43:47 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/6ba29c5b041e431ca8660c2d2ca8aee3/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:43:49.501753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac26d4-61d2-406a-8b65-c7baed1058bf None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.502371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac26d4-61d2-406a-8b65-c7baed1058bf None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.502371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac26d4-61d2-406a-8b65-c7baed1058bf None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.504036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 278/555] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:49.510397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.511084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.511229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.539180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:49.540405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:49.612937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 278/556] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:49 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:49.640096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac26d4-61d2-406a-8b65-c7baed1058bf None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.654156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac26d4-61d2-406a-8b65-c7baed1058bf None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.659211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.659926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.660198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.660504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.673744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:49.680023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:49.681106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 279/557] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:49.689605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.702642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fa24-e7d2-4cca-9cff-b96d30bf1a48 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.708101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.708739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.709024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.709299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.710036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:49.710340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.711933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.721000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 279/558] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:49.727340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.739465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbf4d-af37-47f3-bf33-32ea9d1c7e61 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.745164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.745899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.746184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.746464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.759201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.761004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.779333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:49.780454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 280/559] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:49.787030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.799805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32de9-14bd-4db0-9047-5916870a0206 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.804261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.804918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.805179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.805485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.806195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:49.806495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.808086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.821773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 280/560] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:49.827808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.837398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454428d-5b23-4957-8989-df909c848743 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.850613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.851617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.851903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.852172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.870125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.872223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.890883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 12:43:49.891981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 281/561] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:43:49.898247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.909427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805976e-022d-4f55-8000-dd2fe613ab1f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.914903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.915487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.915769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.916042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.916875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:49.917174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.919337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.949240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 281/562] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:49.956104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:49.967362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318520a2-9633-4a7a-8080-9bcc646bec49 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:49.972846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:49.973436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:49.973724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:49.973995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:49.982608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:49.984413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:49.993189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 282/563] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:50.000061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:50.014203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc52315-012b-4529-b38d-cdf15787a9a5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:50.019685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:50.020445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:50.020732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:50.021007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:50.037247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:50.039897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:50.059955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:50.061123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 282/564] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:50.070230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:50.084938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9780-a5ed-46ba-a889-7db387691a7a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:50.093038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:50.093629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:50.093914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:50.094222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:50.094884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:50.095153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:50.096823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:50.110598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 283/565] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:50.116385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:50.126586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa7868-5ccd-4b39-9d7a-972af5a202bd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:50.131975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:50.132734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:50.133013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:50.133259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:50.143828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:50.145866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:50.159808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:50.160926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 283/566] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:50.167713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:50.183543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd105-3d32-4630-b95e-96e7af01e3a0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:50.189565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:50.190154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:50.190434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:50.190711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:50.191465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:50.191766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:50.193661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f8da4-216b-4d1e-9e45-ef6c2cab77ed admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:50.207021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 284/567] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:50.213340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:50.223841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3242d-f9c3-410e-ab42-4ee9a0cc78c6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:50.231792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:50.232921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:50.233311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:50.233665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:50.234827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=6ba29c5b041e431ca8660c2d2ca8aee3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:50.235222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:50.238133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85debc8e-d614-4712-a76b-d1ab92ce926b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:50.248779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 284/568] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:50 2021] GET /identity/v3/role_assignments?user.id=6ba29c5b041e431ca8660c2d2ca8aee3&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:52.391096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85a6d-be81-4bda-8b8d-df34c6662029 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:52.391950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85a6d-be81-4bda-8b8d-df34c6662029 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:52.391950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85a6d-be81-4bda-8b8d-df34c6662029 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:52.394744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 285/569] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:52.403672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:52.404119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:52.404212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:52.429257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:52.430387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:52.439209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 285/570] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:52 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:52.464281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85a6d-be81-4bda-8b8d-df34c6662029 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:52.478175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85a6d-be81-4bda-8b8d-df34c6662029 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:52.483132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:52.483887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:52.484175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:52.484490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:52.496468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:52.498419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:52.515945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:52.517119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 286/571] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:52.524131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:52.535364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7155-9491-4cb2-a6f4-19d77c1f1ecd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:52.541452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:52.542043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:52.542328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:52.542604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:52.543312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:52.543606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:52.545243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c7f78-8152-4d56-a1a6-1610e7b5ba2d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:52.559390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 286/572] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:52.568304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:52.583612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1ec7-2410-4a19-b688-82055ebf078c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:52.591368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:52.591951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:52.592230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:52.592540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:52.593203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:52.595129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c8efb-6e96-4e6e-a460-c3a95e2b8b74 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:52.624335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 287/573] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:43:52 2021] POST /identity/v3/users => generated 254 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:43:54.747163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea198-c92e-47c1-8070-e6e45aac79db None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:54.747990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea198-c92e-47c1-8070-e6e45aac79db None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:54.747990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea198-c92e-47c1-8070-e6e45aac79db None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:54.750776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 287/574] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:54.759703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:54.760437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:54.760695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:54.792086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:54.793403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:54.802154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 288/575] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:54 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:54.825534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea198-c92e-47c1-8070-e6e45aac79db None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:54.839052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea198-c92e-47c1-8070-e6e45aac79db None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:54.844332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:54.845068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:54.845345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:54.845648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:54.858469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:54.864749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:54.865866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 288/576] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:54.873012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:54.887750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23f2a-8b58-4a15-b345-7381950c2857 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:54.897545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:54.898505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:54.898974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:54.899428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:54.900640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:54.901148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:54.903719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:54.912714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 289/577] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:54.921775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:54.936708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5e82-0dfc-4e54-85fb-5bd38098e961 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:54.942063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:54.942774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:54.943055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:54.943388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:54.956132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:54.958013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:54.981498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:54.982632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 289/578] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:54.989410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.004139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f14637-be68-40ab-b679-f32f0961f9b2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.011671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.012529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.012816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.013095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.013777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:55.014077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.015683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.030983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 290/579] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:55.036794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.047379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2660-9122-40f5-9102-448cfee49ff2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.052418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.053148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.053437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.053725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.067461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.069530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.087845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:43:55.088988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 290/580] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:55.095006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.105140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acfa1c-da01-4069-aa85-d55ed63dd2a7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.110387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.110978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.111262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.111531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.112343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:55.112638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.114483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.148833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 291/581] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:55.157945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.171882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785479-5331-4f64-b6e0-50e7bb89ba71 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.177877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.178451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.178730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.179000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.187111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.189011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.197504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 291/582] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:43:55.204355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.220527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caafbb6-3a74-479e-93ac-ddb4c83e69e6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.229882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.231027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.231309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.231581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.244755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.246647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.264942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:55.265988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 292/583] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:55.271738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.281855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5056c3-72a4-4add-871c-36c0bc517749 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.287656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.288301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.288542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.288823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.289522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:55.289819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.291419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.305816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 292/584] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:55.311764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.322275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8272-c2d6-4c7a-abc0-05e961431e10 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.328137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.328883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.329172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.329439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.342436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.345640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.367802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:55.369434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 293/585] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:55.378968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.394266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7311-f019-40b2-a83c-ebb8aeed6ab2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.400923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.402217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.403010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.403277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.404046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:55.404376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.406244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f5085-6e02-4722-b07e-65191442f076 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.419926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 293/586] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:55.426438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:55.436957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66865b7-e530-437d-a24e-ddd8a8c44872 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:55.441739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:55.442342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:55.442601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:55.442879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:55.443656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=f7e7bd8645b84c6bafd9304672d61a98) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:55.443956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:55.445828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc4d3-9869-4b8b-a752-187ab7b515cc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:55.451615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 294/587] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:43:55 2021] GET /identity/v3/role_assignments?user.id=f7e7bd8645b84c6bafd9304672d61a98&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:57.501673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b74bb8-2f5c-4782-beef-cc946efc3502 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.502700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b74bb8-2f5c-4782-beef-cc946efc3502 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.502700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b74bb8-2f5c-4782-beef-cc946efc3502 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.505282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 294/588] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:43:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:43:57.511617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.512372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.512613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.537387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:43:57.538573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:43:57.547322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 295/589] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:43:57 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:43:57.570265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b74bb8-2f5c-4782-beef-cc946efc3502 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.584818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b74bb8-2f5c-4782-beef-cc946efc3502 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.590220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.590934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.591215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.591489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.603064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:43:57.609378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:43:57.610465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 295/590] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:57.619940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.628821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c7f17-4720-4a3a-a921-29c2653264c0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.633800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.634405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.634678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.634959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.635699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:57.636004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.637709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.646171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 296/591] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:43:57.652213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.662192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b882ed-3c94-4536-adf3-47e4042aabe5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.668495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.669190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.669463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.669735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.681674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.683487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.709593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:57.711304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 296/592] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:43:57.719037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.729395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde782-08aa-4fd5-9358-198201cee3bf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.735077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.735666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.735950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.736226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.736968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:57.737265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.738862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.753428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 297/593] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:57.759310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.772965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d541-cc2d-44e8-bfbe-3ef6db1519af admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.781117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.781811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.782095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.782371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.796623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.798642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.817029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:43:57.818190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 297/594] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:57.824839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.834957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82747337-c4dd-47d7-87cd-28ae0ecc7d9a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.840993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.841611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.841899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.842175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.842992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:57.843292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.845194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.875475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 298/595] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:57.883360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.894240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02958596-e3e8-4e0f-ba2c-09f843760c30 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.903513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.904265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.904563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.904844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.917777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.919845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.938045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:43:57.939241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 298/596] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:57.945436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.955374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b74f-1926-4381-a4b9-ebd7d44c1e52 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:57.960497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:57.961099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:57.961381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:57.961657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:57.962355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:57.962646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:57.964272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:57.977334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 299/597] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:57.983897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:57.993978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95b72-1f06-473e-a4ad-c0ba7caf1353 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:58.000352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:58.001224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:58.001548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:58.001818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:58.011707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:58.014115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:58.034340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:43:58.035868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 299/598] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:43:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:43:58.042398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:58.058428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c320c-77cd-4e91-baec-1703afb45e2c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:58.063520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:58.064146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:58.064465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:58.064730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:58.065492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:43:58.065812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:58.067690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ac3ed-cf36-42bb-8c29-51d89a6d851d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:58.082299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 300/599] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:43:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:43:58.088732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:43:58.099057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888e92-6206-456e-b7af-2f308bb1b12c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:43:58.105642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:43:58.106528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:43:58.106804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:43:58.107084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/f7e7bd8645b84c6bafd9304672d61a98/roles/852684ea01d74d47b176096f6297c602` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:43:58.129772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=f7e7bd8645b84c6bafd9304672d61a98, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:43:58.132471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946254a-5ed4-47cf-bab9-515e44e40241 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:43:58.147954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 300/600] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:43:58 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/f7e7bd8645b84c6bafd9304672d61a98/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:44:00.242130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf00c-d474-41fc-8e51-c7c60f037d5f None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.242701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf00c-d474-41fc-8e51-c7c60f037d5f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.242701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf00c-d474-41fc-8e51-c7c60f037d5f None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.244359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 301/601] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:00.249879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.250343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.250432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.273950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:00.275128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:00.341637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 301/602] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:00 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:00.365483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf00c-d474-41fc-8e51-c7c60f037d5f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.379085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf00c-d474-41fc-8e51-c7c60f037d5f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.384093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.384863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.385144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.385422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.397903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:00.404570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:44:00.405687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 302/603] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:00.412096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.421383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f8e2-3e72-4c7d-93ed-5222acf4dca8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.427285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.427875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.428161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.428474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.429194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.429492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.431087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.440039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 302/604] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:00.445711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.456767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b090706-64f4-46d6-be5d-3cecee47b9fd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.462067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.462836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.463114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.463387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.475873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.477775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.495998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:00.497240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 303/605] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:00.503439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.513531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a29b-707d-4ca9-b8fe-4758c1425d03 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.518629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.519229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.519512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.519797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.520537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.520835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.522532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.536122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 303/606] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:00.541711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.551683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff62-e9db-45e5-87d9-cf86f8013a5b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.557087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.557815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.558091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.558363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.573454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.575552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.594025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:44:00.595129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 304/607] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:00.601253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.611441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8427-f8a2-4bbb-a3c0-29df581b67d7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.617048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.617639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.617921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.618196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.619007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.619307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.621325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.650394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 304/608] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:00.656616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.666503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc2e4e-4e9c-4110-a114-aa5d99df5995 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.672531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.673222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.673546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.673826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.682452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.684378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.693068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 305/609] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:44:00.699069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.709423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3ee39-5dc8-44a4-99c2-41435356abad admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.714794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.715572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.715930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.716225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.728471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.730316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.747841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:00.748934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 305/610] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:00.755019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.764088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3126b5-1942-456e-a6f4-400097263d39 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.769464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.770048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.770325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.770594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.771281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.771587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.773211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.787534 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 306/611] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:00.793530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.803875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dccd-ade8-4904-8050-41f086e5d148 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.809420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.810135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.810413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.810689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.820273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.822239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.836469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:00.837845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 306/612] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:00.843834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.853878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d174001-ca4a-433a-a625-d9bca722beff admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.859320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.859932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.860221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.860532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.861308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.861587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.863455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5812ef3-c91a-439b-9311-2d1156331b9b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.877034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 307/613] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:00.883367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:00.893939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf83399-1c1e-4733-a6b7-047e27b87a1e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:00.899681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:00.900260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:00.900573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:00.900849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:00.902000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=f7e7bd8645b84c6bafd9304672d61a98) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:00.902278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:00.904436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02c4f3-c53b-420c-91b9-8ef39e37a71c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:00.910738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 307/614] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:44:00 2021] GET /identity/v3/role_assignments?user.id=f7e7bd8645b84c6bafd9304672d61a98&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.053641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d20-cde9-4832-b925-7a5b34addd1c None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.054485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d20-cde9-4832-b925-7a5b34addd1c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.054485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d20-cde9-4832-b925-7a5b34addd1c None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.057322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 308/615] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:03.062998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.063440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.063526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.088721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:03.090045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:03.098592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 308/616] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:03 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:03.121919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439d20-cde9-4832-b925-7a5b34addd1c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.140609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439d20-cde9-4832-b925-7a5b34addd1c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.149275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.150354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.150772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.151537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.164572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:03.171473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:44:03.172652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 309/617] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:03.179175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.188375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d864e7-1743-4350-b554-0b4f55ddd1fe None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.193865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.194470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.194754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.195037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.195770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.196073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.197709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.206460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 309/618] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.212467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.224404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89964-3d98-404c-a8ca-a737a72145ed admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.230940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.231690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.231979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.232277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.245812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.247877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.266538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:03.267641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 310/619] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:03.277667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.292764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2267ef-960c-401d-ac38-b79a62a350ec admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.299107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.299699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.299981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.300302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.300955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.301250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.302810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.316695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 310/620] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.322906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.333666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c775-aca1-4e00-b4b6-480a0761a3d9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.339090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.339850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.341189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.341189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.354508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.356726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.375006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:44:03.376120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 311/621] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:03.382295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.392819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4c8dc-6a9f-477a-989a-031bf908d7fe admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.398213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.398799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.399083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.399368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.400169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.400480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.402681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.433930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 311/622] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.440513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.454219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243e480-aa65-41f9-8f0b-c5ebc85145ae admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.459682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.460260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.460563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.460835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.469622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.471376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.480081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 312/623] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:44:03.489328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.505085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f274-e786-4f51-b3c7-662603aef684 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.513457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.514180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.514462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.514740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.527148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.529065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.545952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:03.547027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 312/624] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:03.553411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.564572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc6a43-9112-405e-9e7b-6da026d2dbb5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.570420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.571007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.571287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.571560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.572269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.572573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.574201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.587263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 313/625] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.593061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.602577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b4a45-c819-41d6-b7ff-a79ae246accc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.607418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.608119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.608429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.608711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.617435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.619366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.633332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:03.634402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 313/626] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:03.640402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.650836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cbe29-960e-4d42-b38d-02fc5b7e7667 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.657193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.657771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.658057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.658336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.659073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.659369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.661254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c70bec-86db-4592-baa3-8228f2e6c742 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.674626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 314/627] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:03.680647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:03.692178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cfe33-c52f-48dc-bf66-b3738fda37a8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:03.700101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:03.701053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:03.701438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:03.701809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:03.702901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] RBAC: Adding query filter params (role.id=28dd13be26e84a85b92ffc3e197714c4, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=f7e7bd8645b84c6bafd9304672d61a98) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:03.703287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:03.705999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0e7d-6db1-405d-9954-48e930000334 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:03.715461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 314/628] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:44:03 2021] GET /identity/v3/role_assignments?user.id=f7e7bd8645b84c6bafd9304672d61a98&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=28dd13be26e84a85b92ffc3e197714c4 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:05.785982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2c02-68b3-4a6f-9eff-bdc2479f940e None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:05.786822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2c02-68b3-4a6f-9eff-bdc2479f940e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:05.786822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2c02-68b3-4a6f-9eff-bdc2479f940e None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:05.789628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 315/629] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:05.795634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:05.796388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:05.796388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:05.819811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:05.820998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:05.828192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 315/630] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:05 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:05.852563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2c02-68b3-4a6f-9eff-bdc2479f940e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:05.872220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2c02-68b3-4a6f-9eff-bdc2479f940e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:05.876309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:05.877050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:05.877342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:05.877621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:05.889473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:05.896186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:44:05.897309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 316/631] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:44:05 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:44:05.904611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:05.919193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9835-8e76-4767-8f99-d3a0e427b341 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:05.926532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:05.927446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:05.927859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:05.928288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:05.929432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:05.929865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:05.932423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:05.942660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 316/632] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:44:05 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:05.948415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:05.959006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161baf-9893-436b-8814-fb50fb91554a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:05.965180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:05.966017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:05.966297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:05.966569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:05.979073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:05.981000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:05.999097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:06.000216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 317/633] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:06.008807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.024307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb9a51-e175-4ae5-832b-dac0ce20a1f7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.031555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.032131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.032446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.032680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.033391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:06.033688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.035261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.048620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 317/634] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:06.054851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.067476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e4b9b-147c-4eed-88d9-6b532671d043 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.073088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.073828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.074103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.074392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.098173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.100209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.119222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:44:06.120343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 318/635] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:06.126475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.139854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864898d-22fc-44b1-b74b-8396aa0dcf34 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.148908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.149833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.150289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.150736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.152406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:06.152966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.155178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.186223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 318/636] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:06.195387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.207670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe736c58-6c5f-42cd-841e-d9a157b01b43 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.213753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.214483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.214771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.215050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.233521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.235402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.252745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:06.253860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 319/637] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:06.262446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.271917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b5055-cfe0-4f8d-94d6-fe38c3380345 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.276634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.277246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.277538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.278051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.278800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:06.279069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.280770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.292959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 319/638] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:06.298883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.308447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a65a7-7837-4db3-a988-b017e3b4d386 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.313076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.313781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.314057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.314346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.324163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.326225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.339976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:06.341278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 320/639] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:44:06.347784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.360419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa54667-3eb2-4017-ba40-859541a92ca2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.365671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.366258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.366546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.366825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.367579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:06.367884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.369771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872307-80a0-4dc6-bb88-4e6fdac5d7c5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.383216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 320/640] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:06.391450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:06.407168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ad98-19e9-44bf-95e1-8394a108cd0e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:06.414298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:06.415445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:06.415815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:06.416151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/f7e7bd8645b84c6bafd9304672d61a98/roles/28dd13be26e84a85b92ffc3e197714c4` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:06.419357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=f7e7bd8645b84c6bafd9304672d61a98, role_id=28dd13be26e84a85b92ffc3e197714c4)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:06.422049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418723b-fa93-49a3-a056-fa5141c2b0a3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:06.438850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 321/641] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:44:06 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/f7e7bd8645b84c6bafd9304672d61a98/roles/28dd13be26e84a85b92ffc3e197714c4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:44:08.512037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9cb8-5265-4b90-9376-a151dd5b337a None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.512661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9cb8-5265-4b90-9376-a151dd5b337a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.512779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde9cb8-5265-4b90-9376-a151dd5b337a None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.514378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 321/642] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:08.520605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.521340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.521429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.556922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:08.558642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:08.630023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 322/643] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:08 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:08.654086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9cb8-5265-4b90-9376-a151dd5b337a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.669314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde9cb8-5265-4b90-9376-a151dd5b337a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.674007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.674736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.675017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.675291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.686927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:08.693644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 12:44:08.694780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 322/644] 10.222.0.60 () {56 vars in 1141 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:08.700956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.709832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbe878-6e53-4331-8746-5ddc41ff8aa9 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.714215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.714796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.715075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.715648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.716577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:08.716873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.718503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:08.726897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 323/645] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:08.733224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.749056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab729-9fdc-4070-984e-2d274969f4ff admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.757590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.758630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.759019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.759364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.772302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.774141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:08.794673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:08.795824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 323/646] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:08.801652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.811975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3ec0-a382-458a-8907-1e6ee5639fba admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.817490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.818075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.818362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.818639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.819334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:08.819635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.821282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:08.834428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 324/647] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:08.840688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.855842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264771-a308-43ff-9fa3-9fa08f5bc1ea admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.863845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.865075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.865498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.865908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.881205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.883207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:08.901586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 12:44:08.902641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 324/648] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:08.909256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.924652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4d15-9976-4103-aadf-a77ad9d5456c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.933139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.934030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.934387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.934771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.935470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:08.936822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.937688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:08.966705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 325/649] 10.222.0.60 () {56 vars in 1170 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:08.972898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:08.982677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f237f0-a299-4c4a-88ae-e465136f362f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:08.987222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:08.987783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:08.988070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:08.988377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:08.996143 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:08.997953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.006727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 325/650] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:08 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:44:09.012578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:09.023297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2f7-28ee-4363-aaa2-ec5cfc78e487 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:09.029729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:09.030464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:09.030741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:09.031012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:09.044111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:09.046051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.064174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:09.065304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 326/651] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:09.071365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:09.080322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512bea-3983-4101-bf03-59d43c6d0603 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:09.085583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:09.086154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:09.086438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:09.086708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:09.087412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:09.087703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:09.089276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.102401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 326/652] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:09.108462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:09.118544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425306f9-8fe8-4074-86b1-47063e143325 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:09.124046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:09.124810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:09.125090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:09.125366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:09.135314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:09.137404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.152167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:09.153392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 327/653] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:09.160217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:09.173407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0fe0-508b-4e60-b6e8-055850afcd46 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:09.178812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:09.179378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:09.179656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:09.179961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:09.180727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:09.181020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:09.182846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff25c0-023c-4e96-972d-70486ddd92ee admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.198416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 327/654] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:09.205673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:09.220791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ee153-70c2-4998-8433-481b240e60b4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:09.228916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:09.229713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:09.230088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:09.230444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:09.231592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] RBAC: Adding query filter params (role.id=28dd13be26e84a85b92ffc3e197714c4, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=f7e7bd8645b84c6bafd9304672d61a98) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:09.231903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:09.233782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f66e7-e80f-45be-8486-c9b51bbea89e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:09.239821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 328/655] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:44:09 2021] GET /identity/v3/role_assignments?user.id=f7e7bd8645b84c6bafd9304672d61a98&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=28dd13be26e84a85b92ffc3e197714c4 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:11.451089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfedc5-ead9-4e48-976e-44f6b494b1ce None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:11.452170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfedc5-ead9-4e48-976e-44f6b494b1ce None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:11.452170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfedc5-ead9-4e48-976e-44f6b494b1ce None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:11.454720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 328/656] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:11.460105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c53e-0caf-455b-808a-249b87784597 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:11.460606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c53e-0caf-455b-808a-249b87784597 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:11.460703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c53e-0caf-455b-808a-249b87784597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:11.491016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c050c53e-0caf-455b-808a-249b87784597 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:11.492224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c050c53e-0caf-455b-808a-249b87784597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:11.500016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 329/657] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:11 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:11.522594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfedc5-ead9-4e48-976e-44f6b494b1ce None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:11.537414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfedc5-ead9-4e48-976e-44f6b494b1ce None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:11.542229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:11.542967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:11.543264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:11.543645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:11.544301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:11.545900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:11.556841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 12:44:11.557957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 329/658] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Nov 23 12:44:11 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:11.564475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050c53e-0caf-455b-808a-249b87784597 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:11.577200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050c53e-0caf-455b-808a-249b87784597 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:11.582730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:11.583330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:11.583609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:11.583881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:11.584593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:11.584887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:11.586483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a7ee7-d5b6-4294-b356-07d6aec70a98 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:11.591066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 330/659] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:11 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:11.597306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:11.607510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9477e6-345f-4e4e-ac35-b7d63aa0cea7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:11.612751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:11.613340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:11.613613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:11.613898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:11.614554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:11.614884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:11.616491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ca4f-1a0a-474b-bbff-eff728658911 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:11.621242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 330/660] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:11 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:13.697397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ca345-9de2-4de2-801f-8788d4928ff3 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:13.698001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ca345-9de2-4de2-801f-8788d4928ff3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:13.698001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ca345-9de2-4de2-801f-8788d4928ff3 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:13.699795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 331/661] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:13.705820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c319-87a2-4811-9189-7a96c80a1a45 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:13.706293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c319-87a2-4811-9189-7a96c80a1a45 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:13.706389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c319-87a2-4811-9189-7a96c80a1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:13.729167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6618c319-87a2-4811-9189-7a96c80a1a45 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:13.730336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6618c319-87a2-4811-9189-7a96c80a1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:13.737971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 331/662] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:13 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:44:13.761040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ca345-9de2-4de2-801f-8788d4928ff3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:13.775411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ca345-9de2-4de2-801f-8788d4928ff3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:13.780779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:13.781378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:13.781664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:13.781946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:13.782623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:13.784259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a9159-7b0d-423e-a4b6-ae229fac14c9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:13.800679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 332/663] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:44:13 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:15.902457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c73c-66c8-4747-abc4-b7394c28ec9f None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:15.903135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c73c-66c8-4747-abc4-b7394c28ec9f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:15.903135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c73c-66c8-4747-abc4-b7394c28ec9f None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:15.904968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 332/664] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:15.910439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:15.910854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:15.910978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:15.933538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:15.934678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:15.955971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 333/665] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:15 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:15.979090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c73c-66c8-4747-abc4-b7394c28ec9f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:16.000171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c73c-66c8-4747-abc4-b7394c28ec9f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:16.008475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:16.009491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:16.009876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:16.010257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] PATH_INFO: `/v3/services/image` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:16.011226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:16.013203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:16.023949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 12:44:16.025089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 333/666] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Nov 23 12:44:15 2021] GET /identity/v3/services/image => generated 86 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:16.031714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:16.040924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8e00-cd85-48ca-9727-3ea2ed57d1d0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:16.047139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:16.047741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:16.048022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:16.048339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:16.049017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] RBAC: Adding query filter params (name=image) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:16.049313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:16.050926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:16.056161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 334/667] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:16 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:16.062640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:16.077321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386fb69-6001-4a44-8448-9303ad0f281d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:16.082858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:16.083436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:16.083694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:16.083965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:16.084717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] RBAC: Adding query filter params (type=image) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:16.085016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:16.086587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:16.091937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 334/668] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:16 2021] GET /identity/v3/services?type=image => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:16.098037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:16.108220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9443fdb-58ed-472a-8977-a3cac6a77aae admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:16.113646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:16.114255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:16.114537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:16.114809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:16.115554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] RBAC: Adding query filter params (interface=public, service_id=a36dda465cfe4de08fa5902bd06e4757, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:16.115857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:16.117499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d687-09a7-48a3-8ec5-df602c748cab admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:16.123039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 335/669] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:44:16 2021] GET /identity/v3/endpoints?service_id=a36dda465cfe4de08fa5902bd06e4757&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:16.128756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:16.139320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89dd5-f619-4ca0-a08f-c19df30b854c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:16.145654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:16.146227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:16.146504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:16.146771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:16.147408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:16.149008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf6a12-b0af-4664-9a55-6bca9f34f8b5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:16.155644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 335/670] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:44:16 2021] GET /identity/v3/services => generated 1022 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:44:18.247918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4416-2137-4463-9fce-d800ea8f6b2e None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.248512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4416-2137-4463-9fce-d800ea8f6b2e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.248512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4416-2137-4463-9fce-d800ea8f6b2e None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.250167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 336/671] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:18.255491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.255915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.256000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.279317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:18.280505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:18.288123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 336/672] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:18 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:18.311755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4416-2137-4463-9fce-d800ea8f6b2e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:18.325658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4416-2137-4463-9fce-d800ea8f6b2e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:18.330570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:18.331283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.331574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.331851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] PATH_INFO: `/v3/services/image` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.332514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:18.334128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:18.344479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 12:44:18.345549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 337/673] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Nov 23 12:44:18 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:18.351892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:18.361133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23f4e3-0ccd-4e13-a6a7-0b46153106a5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:18.365559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:18.366157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.366439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.366714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.367383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:18.367676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:18.369303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:18.374260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 337/674] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:18 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:18.380539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:18.390767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb4f4-abcf-4183-a4ff-31c5b553697a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:18.395448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:18.396040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.396364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.396637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.397311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] RBAC: Adding query filter params (type=image) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:18.397608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:18.399221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6a572-d8fa-4ac9-8e9a-70fad1e0e7dd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:18.404815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 338/675] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:18 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:18.410780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:18.421152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502c387-3e56-4949-8c7e-5ae45974bc44 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:18.426583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:18.427178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:18.427452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:18.427720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:18.428448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:18.430043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843124b5-fb16-42c9-89bf-18bbe2ff794a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:18.450881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 338/676] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:44:18 2021] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:20.566279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479544-3718-4db9-9155-a2e0a54246d8 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:20.566885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479544-3718-4db9-9155-a2e0a54246d8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:20.566885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479544-3718-4db9-9155-a2e0a54246d8 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:20.568588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 339/677] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:20.574503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:20.574976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:20.575093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:20.597558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:20.598702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:20.616476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 339/678] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:20 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:44:20.638981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be479544-3718-4db9-9155-a2e0a54246d8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:20.652475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be479544-3718-4db9-9155-a2e0a54246d8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:20.657010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:20.657579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:20.657861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:20.658142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:20.666141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:20.668026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584b4a5-1908-4943-829d-f28f649a7626 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:20.677623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 340/679] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:20 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:44:20.683776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:20.693786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b89f1-699f-4ab3-8828-7ec0e125e9e1 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:20.699511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:20.700555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:20.700833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:20.701105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:20.702378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:20.704082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa938a-d353-4cd7-a190-ebb254c9543a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:20.705607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 340/680] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:23.016391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83fe82-1132-42a7-948b-0cc13c5a44d0 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:23.016938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83fe82-1132-42a7-948b-0cc13c5a44d0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:23.016938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83fe82-1132-42a7-948b-0cc13c5a44d0 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:23.019521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 341/681] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:23.027971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:23.028494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:23.028600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:23.052765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:23.053938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:23.062151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 341/682] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:23 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:44:23.096561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83fe82-1132-42a7-948b-0cc13c5a44d0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:23.110288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83fe82-1132-42a7-948b-0cc13c5a44d0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:23.115083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:23.115804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:23.116082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:23.116394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:23.130071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:23.131917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:23.154573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:23.155703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 342/683] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:23.162071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:23.171170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44b81-daf5-4b65-939a-06d6b2fa51e4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:23.177439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:23.178035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:23.178297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:23.178594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:23.179265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:23.179585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:23.181208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f8c67-ed14-4f5e-860b-217056a88753 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:23.199400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 342/684] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:23.208610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:23.221647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc722f-4039-4a7c-ac9d-be846dc2694a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:23.227198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:23.227801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:23.228080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:23.228390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:23.229041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:23.230958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54032eb-a25c-4f1d-aef9-c3087da381b5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:23.258380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 343/685] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:44:23 2021] POST /identity/v3/users => generated 248 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:25.370562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c4f-dcaf-417e-80d4-5b3d90938033 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.371213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c4f-dcaf-417e-80d4-5b3d90938033 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.371213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83c4f-dcaf-417e-80d4-5b3d90938033 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.372978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 343/686] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:25.378522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.379073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.379073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.403072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:25.404266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:25.412339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 344/687] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:25 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:25.436275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83c4f-dcaf-417e-80d4-5b3d90938033 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.450171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83c4f-dcaf-417e-80d4-5b3d90938033 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.455369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.456095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.456414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.456691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.469316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:25.475645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:44:25.476796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 344/688] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:25.483832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.493014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee92fa9-ef35-4be4-980d-5007de27ba68 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.498299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.498901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.499193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.499472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.500224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.500561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.502198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.511416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 345/689] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:25.517373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.528026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d4616-eaa6-4695-88f5-a9feb9238541 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.533666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.534399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.534677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.534976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.547671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.549572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.567639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:25.568826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 345/690] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:25.575094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.585458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1fda7-7fc4-478b-9484-6157e0c60c49 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.590866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.591474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.591733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.592012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.592746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.593067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.594669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.608160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 346/691] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:25.614115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.624515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91c8d-11fb-4289-a3de-7a4457aade98 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.629077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.629820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.630104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.630381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.644149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.646211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.666132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 12:44:25.667384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 346/692] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:25.674330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.684984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260bd0-e4df-4d97-9d41-6190dd088485 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.689868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.690491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.690772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.691057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.691849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.692147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.694059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.725055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 347/693] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:25.731924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.743644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b701-4ef8-4172-bdf3-0bb04bb91bfb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.751188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.752021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.752824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.752824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.764532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.766309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.775747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 347/694] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:44:25.782097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.792287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7530a-be33-455c-8eab-3df3bac71d96 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.797813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.798523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.798803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.799073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.813103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.815171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.833853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:25.835027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 348/695] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:25.841665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.853574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75195f-b87a-4c10-84ed-e8b9a117b5d7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.858658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.859333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.859496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.859795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.860532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.860819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.862411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.875526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 348/696] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:25.881390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.891595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db85ad-8173-4c5d-b116-7ba086452d46 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.897047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.897771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.898056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.898335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.907586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.909611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.924068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:25.925230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 349/697] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:25.931948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.942555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4543455-3a8d-4338-aeec-fe76245d876f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.947792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.948422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.948706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.948987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.949890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.950189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.952065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8af55-9f98-4789-ad59-1735a7f4c897 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:25.966309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 349/698] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:25.973384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:25.984278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c0322-f3cf-47d2-9fad-3ab45e73b77e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:25.990002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:25.990618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:25.990903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:25.991178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:25.991971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=4f54266b73f542309722b317e80e5f95) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:25.992284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:25.994193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f890347-8586-43e7-b4ea-7e79de005d91 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:26.000801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 350/699] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:44:25 2021] GET /identity/v3/role_assignments?user.id=4f54266b73f542309722b317e80e5f95&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.087438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1471-3654-4215-acd7-4a49f7a0501a None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.087990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1471-3654-4215-acd7-4a49f7a0501a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.087990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1471-3654-4215-acd7-4a49f7a0501a None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.089630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 350/700] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:28.095356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.095813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.095898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.122125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:28.123338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:28.130908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 351/701] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:28 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:28.155285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df1471-3654-4215-acd7-4a49f7a0501a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.169117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df1471-3654-4215-acd7-4a49f7a0501a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.173622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.174351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.174634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.174909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.188260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:28.194484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:44:28.195729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 351/702] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:28.202584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.211748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410f6e8-494d-4ca8-94ef-c431e39ae286 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.216998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.217612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.217896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.218177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.218889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:28.219191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.220858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.230499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 352/703] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.236967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.248039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b96e-84d3-4c0e-8b18-37ec9df90b07 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.252921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.253769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.254055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.254419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.268141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.270111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.290769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:28.291976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 352/704] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:28.298690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.309370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68ff1-155a-4323-861b-7e7e21e1cc29 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.314303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.314931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.315222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.315497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.316209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:28.316537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.318200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.333247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 353/705] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.339460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.351624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03473fe-ec0a-4329-889d-32fa643cb7ba admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.357365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.358106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.358383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.358653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.373107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.375151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.394498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 12:44:28.395682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 353/706] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:28.402341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.413010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26589-f159-4fb4-b809-00315453cf79 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.418984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.419626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.419915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.420191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.421042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:28.421342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.423247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.454965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 354/707] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.461744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.473717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241126-06db-4213-a3da-71ec92fd52c4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.479696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.481015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.481491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.481774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.500089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.501969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.520964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:28.522116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 354/708] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:28.528895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.543942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ba89-1214-4c1c-aba7-ce19c6dd2a3c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.551532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.552410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.552832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.553209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.554256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:28.554710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.557313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.570167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 355/709] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.579196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.592870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeb62-5fb6-4861-8065-f3829e314231 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.598137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.598873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.599158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.599409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.608359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.610331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.624522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:28.625618 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 355/710] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:28.632216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.646365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472eef-e2e5-4700-a72d-c9f120b6c28d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.651770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.652424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.652708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.652987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.653734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:28.654037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.655911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4005da-3b5f-4e87-ab47-c635a2666224 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.671729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 356/711] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:28.677672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:28.688024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522895af-3b72-4f9e-a348-a2def2dedebc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:28.693110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:28.693914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:28.694188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:28.694471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/4f54266b73f542309722b317e80e5f95/roles/852684ea01d74d47b176096f6297c602` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:28.716268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=4f54266b73f542309722b317e80e5f95, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:28.718889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54de6-1865-4306-a02d-58218a43e6aa admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:28.740902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 356/712] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:44:28 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/4f54266b73f542309722b317e80e5f95/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:44:30.812834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2a2b-35ad-4b12-a136-2089e327f37f None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:30.813444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2a2b-35ad-4b12-a136-2089e327f37f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:30.813444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2a2b-35ad-4b12-a136-2089e327f37f None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:30.815109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 357/713] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:30.820815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:30.821353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:30.821459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:30.845107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:30.846264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:30.913418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 357/714] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:30 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:30.937377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f2a2b-35ad-4b12-a136-2089e327f37f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:30.956402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f2a2b-35ad-4b12-a136-2089e327f37f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:30.962545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:30.963275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:30.963557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:30.963822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:30.977433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:44:30.983874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:44:30.985038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 358/715] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:44:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:30.994838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.009071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462447b-8432-43de-83d9-02cc86f6f032 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.014506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.015103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.015388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.015665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.016476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.016773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.018421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.027485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 358/716] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:44:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:31.033674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.044018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51f86-0230-453b-95ae-f28cb61e7c94 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.049193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.049907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.050191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.050466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.062378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.064332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.092018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:31.093158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 359/717] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:31.099298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.109703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43efbd4-8cb1-434c-9e4e-079b11cd8373 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.114489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.115079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.115368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.115645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.116351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.116645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.118250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.133311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 359/718] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:31.141526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.158136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09085c-8b4b-4999-9f09-b3e1c755fc72 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.167105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.168195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.168501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.168888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.182004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.184409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.202165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 12:44:31.203290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 360/719] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:31.213084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.228762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59518c-1039-47bb-be50-1f3cc7c745ae admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.235687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.236321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.236600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.236876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.237680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.237981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.239845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.269282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 360/720] 10.222.0.60 () {56 vars in 1158 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:31.279148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.296817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726a6e-2740-4cf4-a2fe-2a39ffe4acd4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.302197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.302780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.303063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.303340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.312255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.314057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.323280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 361/721] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:44:31.333264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.346022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820435fd-496f-45d3-b0fd-d6cec79c1981 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.352187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.352943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.353221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.353489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.365960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.367848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.385726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:44:31.386973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 361/722] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:31.393662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.406825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6b59-6ea5-428f-95b5-6343c2ed516c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.413162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.413754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.414032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.414314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.415011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.415309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.416950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.431454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 362/723] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:31.438963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.449092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f21d-bca1-4bd8-9909-16f8c28ae15a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.455045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.455727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.456018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.456269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.467366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.469387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.483745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:44:31.484844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 362/724] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:31.491706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.503793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63fce-a5d1-4b48-9ecd-1d22627a7dfa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.509357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.509943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.510229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.510503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.511310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.511617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.513524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c0fb1-9795-45e4-a5a9-05528c2553e4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.527104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 363/725] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:31.537110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:31.551780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d8db-04a0-4d33-9f76-8e59ce31e910 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:31.557876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:31.558458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:31.558819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:31.559147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:31.560101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=4f54266b73f542309722b317e80e5f95) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:31.560454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:31.562312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e0e22-09f3-4c9a-a7fe-cbf9a6aa53ec admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:31.572877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 363/726] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:44:31 2021] GET /identity/v3/role_assignments?user.id=4f54266b73f542309722b317e80e5f95&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:33.675457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276443-5795-4313-8b5b-e1bf622529e3 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:33.676362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276443-5795-4313-8b5b-e1bf622529e3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:33.676362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276443-5795-4313-8b5b-e1bf622529e3 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:33.678990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 364/727] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:33.684397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:33.684950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:33.684950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:33.714424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:33.716207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:33.724792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 364/728] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:33 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:33.747261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276443-5795-4313-8b5b-e1bf622529e3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:33.762111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276443-5795-4313-8b5b-e1bf622529e3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:33.768012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:33.768772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:33.769053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:33.769325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:33.769979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:33.771568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:33.787317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 12:44:33.789048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 365/729] 10.222.0.60 () {56 vars in 1150 bytes} [Tue Nov 23 12:44:33 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:33.794860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:33.803808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfbd83-1899-426a-8422-366a2056b6ec None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:33.809972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:33.810538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:33.810820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:33.811094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:33.811761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:33.812057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:33.813678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c612a-9bde-46fe-9bee-51e12e87ae3e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:33.818340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 365/730] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:33 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:33.823770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:33.833836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910afaf-5e69-470f-a137-ceb9ccc90442 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:33.839070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:33.839661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:33.839951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:33.840231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:33.840990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:33.841291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:33.842901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f92f5-82b8-42c6-b5af-6e95faa34630 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:33.847870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 366/731] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:33 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:35.909056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baddb6-03f2-4cda-a7ad-77d01ceb4e58 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:35.909939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baddb6-03f2-4cda-a7ad-77d01ceb4e58 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:35.909939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baddb6-03f2-4cda-a7ad-77d01ceb4e58 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:35.912645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 366/732] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:35.922162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9c31-9993-4aea-9254-423abbe1601c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:35.922570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9c31-9993-4aea-9254-423abbe1601c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:35.922818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9c31-9993-4aea-9254-423abbe1601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:35.951116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-658b9c31-9993-4aea-9254-423abbe1601c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:35.952347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-658b9c31-9993-4aea-9254-423abbe1601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:35.960410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 367/733] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:35 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:35.983832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baddb6-03f2-4cda-a7ad-77d01ceb4e58 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:36.003121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baddb6-03f2-4cda-a7ad-77d01ceb4e58 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:36.010171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:36.010809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:36.011104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:36.013379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:36.014098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:36.015702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0c091-4162-4d1f-8d46-e48f3ae89cd7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:36.038192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 367/734] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:44:35 2021] POST /identity/v3/services => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:38.132684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059d1a-ad50-4e48-86b5-0d96fe1fad22 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.133464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059d1a-ad50-4e48-86b5-0d96fe1fad22 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.133464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69059d1a-ad50-4e48-86b5-0d96fe1fad22 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.136073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 368/735] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:38.145328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700402-3130-440e-814a-895309accb47 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.146056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700402-3130-440e-814a-895309accb47 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.146239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700402-3130-440e-814a-895309accb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.174005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-0d700402-3130-440e-814a-895309accb47 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:38.175158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0d700402-3130-440e-814a-895309accb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:38.195903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 368/736] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:38 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:38.226565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69059d1a-ad50-4e48-86b5-0d96fe1fad22 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:38.240888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69059d1a-ad50-4e48-86b5-0d96fe1fad22 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:38.246984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:38.250446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.250737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.251023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.251657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:38.253299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:38.264922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 12:44:38.265999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 369/737] 10.222.0.60 () {56 vars in 1150 bytes} [Tue Nov 23 12:44:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:38.272948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700402-3130-440e-814a-895309accb47 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:38.285253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700402-3130-440e-814a-895309accb47 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:38.290495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:38.291074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.291458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.291608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.292345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:38.292642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:38.294521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:38.299752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 369/738] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:38.305340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:38.315640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6e69-55f7-4d53-8e8c-63e6f7fc7ac5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:38.320712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:38.321293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.321577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.321858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.322505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:38.322840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:38.324449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:38.329777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 370/739] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:38.336506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:38.351407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf7b-3e98-4040-a591-71ed5e320e03 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:38.360092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:38.360940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.361217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.361486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.362644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] RBAC: Adding query filter params (interface=public, service_id=9263c1ca26c44affaab65b7afceb63f6, region_id=RegionOne) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:38.363027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:38.365512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1dab6-54b7-4a28-b4cd-a2abc3057240 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:38.373617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 370/740] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:44:38 2021] GET /identity/v3/endpoints?service_id=9263c1ca26c44affaab65b7afceb63f6&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:38.381864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:38.394535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131921b9-b184-4ddb-8b70-b6b50fec5c1e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:38.401082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f58163-f39c-426d-a837-83287028228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:38.401678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f58163-f39c-426d-a837-83287028228e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:38.401962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f58163-f39c-426d-a837-83287028228e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:38.402245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f58163-f39c-426d-a837-83287028228e admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:38.402911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f58163-f39c-426d-a837-83287028228e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:38.404551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f58163-f39c-426d-a837-83287028228e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:38.410765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 371/741] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:44:38 2021] GET /identity/v3/services => generated 1261 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:44:40.514659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cbc7d-7e44-4c2d-9532-9004760dc597 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.515565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cbc7d-7e44-4c2d-9532-9004760dc597 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.515565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cbc7d-7e44-4c2d-9532-9004760dc597 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.518212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 371/742] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:40.524387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.525432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.525613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.550785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:40.551973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:40.560706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 372/743] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:40 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:40.584739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cbc7d-7e44-4c2d-9532-9004760dc597 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:40.601938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cbc7d-7e44-4c2d-9532-9004760dc597 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:40.607994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:40.608747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.609026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.609298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.609909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:40.611481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:40.623029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 12:44:40.624091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 372/744] 10.222.0.60 () {56 vars in 1150 bytes} [Tue Nov 23 12:44:40 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:40.633270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:40.644731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84d78-6620-4e9d-9da4-0bfd5932acde None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:40.651381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:40.651979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.652277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.652568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.653240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:40.653541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:40.655132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:40.660371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 373/745] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:40 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:40.666031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:40.676834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8be97-9daf-42ee-ba83-c21fd3e0a9da admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:40.682633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:40.683224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.683499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.683777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.684509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:40.684769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:40.686460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4afd55-395b-4897-b9ed-0860141e99c8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:40.691755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 373/746] 10.222.0.60 () {56 vars in 1145 bytes} [Tue Nov 23 12:44:40 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:40.697559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:40.707700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f928-e71d-4ddb-9e17-12f3b64e8777 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:40.713311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:40.713909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:40.714191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:40.714472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:40.715169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:40.716841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4665849-2e93-49fe-adb3-ad34d6c0ba05 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:40.739680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 374/747] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:44:40 2021] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:42.838598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3c9-de1b-47ce-89a7-e1046bef735e None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:42.839065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3c9-de1b-47ce-89a7-e1046bef735e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:42.839163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3c9-de1b-47ce-89a7-e1046bef735e None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:42.840917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 374/748] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:42.846303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125386-0337-4baf-be81-c28150144634 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:42.846782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125386-0337-4baf-be81-c28150144634 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:42.846878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125386-0337-4baf-be81-c28150144634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:42.870726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3b125386-0337-4baf-be81-c28150144634 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:42.871924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3b125386-0337-4baf-be81-c28150144634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:42.890354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 375/749] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:42 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:42.913629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8a3c9-de1b-47ce-89a7-e1046bef735e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:42.929281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8a3c9-de1b-47ce-89a7-e1046bef735e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:42.934985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:42.935702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:42.935977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:42.936274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:42.936896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:42.938500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:42.949362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 23 12:44:42.950492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 375/750] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:42 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:42.960017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125386-0337-4baf-be81-c28150144634 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:42.974686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125386-0337-4baf-be81-c28150144634 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:42.982233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:42.982849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:42.983141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:42.983418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:42.984114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:42.984447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:42.986041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5f4fb-0928-430a-9997-1dbf59498efe admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:42.990771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 376/751] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:42 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:42.997041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:43.013449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1d1d0-4f36-4e61-a2db-a3c765c3b011 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:43.019232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:43.019801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:43.020083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:43.020383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:43.021081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:43.021376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:43.022945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610f8c9-6103-4b26-8f7c-16629ed187c2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:43.027807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 376/752] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:42 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:45.092001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70361-1a60-413b-b4cb-58ccce33d496 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:45.092850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70361-1a60-413b-b4cb-58ccce33d496 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:45.092850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70361-1a60-413b-b4cb-58ccce33d496 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:45.095479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 377/753] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:45.101498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468e21-9033-423f-a84d-4b3372669a7e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:45.101938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468e21-9033-423f-a84d-4b3372669a7e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:45.102039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f468e21-9033-423f-a84d-4b3372669a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:45.125606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1f468e21-9033-423f-a84d-4b3372669a7e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:45.126743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1f468e21-9033-423f-a84d-4b3372669a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:45.134990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 377/754] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:45 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:45.159184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70361-1a60-413b-b4cb-58ccce33d496 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:45.177181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70361-1a60-413b-b4cb-58ccce33d496 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:45.182776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:45.183365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:45.183652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:45.183928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:45.184960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:45.186587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521c9c3-dd0c-4183-806d-ea263fa40670 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:45.203964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 378/755] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:44:45 2021] POST /identity/v3/services => generated 251 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:47.304381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b816b2-7876-49cc-858b-beb25881a5c4 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.305219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b816b2-7876-49cc-858b-beb25881a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.305219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b816b2-7876-49cc-858b-beb25881a5c4 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.307842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 378/756] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:47.314944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.315374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.315519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.347463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:47.348652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:47.368359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 379/757] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:47 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:47.397939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b816b2-7876-49cc-858b-beb25881a5c4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:47.412424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b816b2-7876-49cc-858b-beb25881a5c4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:47.417672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:47.418389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.418761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.419124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.419773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:47.421402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:47.432597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 23 12:44:47.433691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 379/758] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:47 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:47.441022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:47.453912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7a2d-7cca-424d-a826-e522c0a42223 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:47.459806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:47.460459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.460745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.461021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.461708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:47.462006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:47.463646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:47.469094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 380/759] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:47 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:47.474639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:47.484380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc342-0d92-4c9b-ad89-7330d1c8793c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:47.489060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:47.489622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.489960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.490180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.490851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:47.491149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:47.492730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:47.497516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 380/760] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:47 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:47.503286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:47.513441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9d22c-cfe7-41ad-8bcd-be1fdcb0d70a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:47.519380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:47.519969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.520276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.520554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.521291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] RBAC: Adding query filter params (interface=public, service_id=9ef48a51b24b4fe48a599fd47567429e, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:47.521606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:47.523224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4eb5-4a02-4eff-9df4-8a4f48a5445b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:47.529119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 381/761] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:44:47 2021] GET /identity/v3/endpoints?service_id=9ef48a51b24b4fe48a599fd47567429e&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:47.537364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:47.547513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544490d-87a0-4785-8516-2da047129d56 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:47.552938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:47.553544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:47.553830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:47.554108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:47.554808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:47.556368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10252-fc35-49cc-b912-4900c341b198 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:47.562414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 381/762] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:44:47 2021] GET /identity/v3/services => generated 1500 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:44:49.651030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09bda-6883-4f12-96a9-06e81621e023 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.651915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09bda-6883-4f12-96a9-06e81621e023 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.651915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09bda-6883-4f12-96a9-06e81621e023 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.654641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 382/763] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:49.663272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.664004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.664152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.696454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:49.698129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:49.707488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 382/764] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:49 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:49.730725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09bda-6883-4f12-96a9-06e81621e023 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:49.745094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09bda-6883-4f12-96a9-06e81621e023 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:49.750251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:49.750953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.751234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.751509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.752141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:49.753791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:49.764138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Nov 23 12:44:49.765214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 383/765] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:49 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:49.771486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:49.781188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423af6b-9ce1-482c-8ade-bd0167a3a033 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:49.786030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:49.786614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.786940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.787177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.787851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:49.788151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:49.789770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:49.794796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 383/766] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:49 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:49.803396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:49.818625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040746b-8b37-465f-b314-b4c633bdbc87 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:49.825753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:49.826346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.826632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.826932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.827615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:49.827917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:49.829638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6acd9a-8007-41a4-910b-c1486dc98923 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:49.834725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 384/767] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:49 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:49.840715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:49.850888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ebd0-6c82-4208-9fbf-2ac39a76b6f7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:49.857654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:49.858238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:49.858519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:49.858794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:49.859477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:49.861129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d683f-1079-4286-8eb4-0caf2647441b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:49.880679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 384/768] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:44:49 2021] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:51.973538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9e5e-76e6-4267-a05e-775b5207c854 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:51.974123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9e5e-76e6-4267-a05e-775b5207c854 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:51.974123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9e5e-76e6-4267-a05e-775b5207c854 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:51.975783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 385/769] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:51.982828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:51.983313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:51.983418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:52.015682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:52.016860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:52.037605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 385/770] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:51 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:52.062298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f9e5e-76e6-4267-a05e-775b5207c854 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:52.075792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f9e5e-76e6-4267-a05e-775b5207c854 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:52.079903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:52.080662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:52.080944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:52.081219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:52.081859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:52.083453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:52.093708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 12:44:52.094728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 386/771] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:52 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:52.101008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:52.110368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c66b-e5f1-4e17-ba7f-c07d468c4ce1 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:52.115562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:52.116139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:52.116471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:52.116745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:52.117437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:52.117716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:52.119350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331fa7-31b4-4420-98a8-bce07d471ad9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:52.124901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 386/772] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:52 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:52.131185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:52.142053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe37c91-5e6e-47d0-835c-7288a8ae3f82 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:52.146546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:52.147140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:52.147434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:52.147724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:52.148426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:52.148727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:52.150656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2615b2-b0ea-49df-9445-fe713b258dc5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:52.155160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 387/773] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:52 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:54.256120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519097b1-74a1-4162-b0a5-9f4d0b383b28 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:54.257027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519097b1-74a1-4162-b0a5-9f4d0b383b28 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:54.257027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519097b1-74a1-4162-b0a5-9f4d0b383b28 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:54.259592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 387/774] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:54.267152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d83f9-13d5-4d3a-ab4a-7b139361b07f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:54.267596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d83f9-13d5-4d3a-ab4a-7b139361b07f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:54.267708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d83f9-13d5-4d3a-ab4a-7b139361b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:54.300699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-677d83f9-13d5-4d3a-ab4a-7b139361b07f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:54.301977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-677d83f9-13d5-4d3a-ab4a-7b139361b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:54.310028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 388/775] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:54 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:54.333416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519097b1-74a1-4162-b0a5-9f4d0b383b28 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:54.355126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519097b1-74a1-4162-b0a5-9f4d0b383b28 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:54.361573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:54.362174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:54.362460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:54.362732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:54.363404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:54.365030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dd2d5-28a7-437c-a50e-81184da5f677 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:54.382732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 388/776] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:44:54 2021] POST /identity/v3/services => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:44:56.489187 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617542f5-a352-42cc-b544-880119d2fb7d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.490082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617542f5-a352-42cc-b544-880119d2fb7d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.490082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617542f5-a352-42cc-b544-880119d2fb7d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.492579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 389/777] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:56.500831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.501271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.501406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.528440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:56.529591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:56.548950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 389/778] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:56 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:56.572389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617542f5-a352-42cc-b544-880119d2fb7d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:56.587852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617542f5-a352-42cc-b544-880119d2fb7d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:56.593436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:56.594161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.594453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.594734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.595369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:56.597060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:56.608698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 12:44:56.609780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 390/779] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:56.619590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:56.634157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bc616-26fa-4d27-bf00-c1c9fbcb9e39 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:56.640634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:56.641260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.641545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.641821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.642539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:56.642838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:56.644523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:56.649783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 390/780] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:56.655666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:56.665343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cab0d-c503-4cc8-975a-6b729bb7a7d0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:56.671028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:56.671609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.671892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.672168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.672870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:56.673207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:56.674765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:56.679798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 391/781] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:56.685591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:56.696059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f0b97-f1e7-458b-b54f-e3d8b5eb49d2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:56.701553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:56.702102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.702460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.702633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.703467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] RBAC: Adding query filter params (interface=public, service_id=b7f70754f0ad4d8bb68d80d164b993f7, region_id=RegionOne) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:56.703694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:56.705281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690cbd8-af95-469e-a879-240511855c80 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:56.710926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 391/782] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:44:56 2021] GET /identity/v3/endpoints?service_id=b7f70754f0ad4d8bb68d80d164b993f7&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:56.716630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:56.726937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e1e86-6145-4ec6-a37a-47adb3b0bcf4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:56.732719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:56.733329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:56.733605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:56.733876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:56.734552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:56.736146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56f972-badb-4176-b10b-72d98585a9dd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:56.743146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 392/783] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:44:56 2021] GET /identity/v3/services => generated 1739 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:44:58.843106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d429-f773-4e80-9f3a-8ecbc9d903fc None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:58.843573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d429-f773-4e80-9f3a-8ecbc9d903fc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:58.843692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d429-f773-4e80-9f3a-8ecbc9d903fc None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:58.845547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 392/784] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:44:58.851055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:58.851497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:58.851621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:58.877838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:44:58.878996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:44:58.889859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 393/785] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:44:58 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:44:58.913704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d429-f773-4e80-9f3a-8ecbc9d903fc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:58.930079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d429-f773-4e80-9f3a-8ecbc9d903fc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:58.936205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:58.936977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:58.937271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:58.937556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:58.938227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:58.939874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:58.950592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 12:44:58.951676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 393/786] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:58 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:44:58.958021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:58.967554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a479b-4178-46c4-88f9-f13e5e688174 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:58.972982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:58.973573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:58.973858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:58.974125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:58.974822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:58.975112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:58.976790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:58.982201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 394/787] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:58 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:44:58.991458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:59.006970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1e6f3-a5d6-4c25-bbaf-0d9da10cc67f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:59.014819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:59.015395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:59.015679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:59.016004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:59.016663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:44:59.016955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:59.018539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e1e68-f43d-474a-ba4d-9de148895726 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:59.024207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 394/788] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:44:58 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:44:59.031039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:44:59.046625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37c1b9-16c7-4edb-9948-2cb8c767db02 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:44:59.055482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:44:59.056399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:44:59.056716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:44:59.057107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:44:59.058160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:44:59.060309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f48f2-109f-40bb-bbb9-66b251a4a15c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:44:59.082303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 395/789] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:44:59 2021] POST /identity/v3/endpoints => generated 346 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:01.196856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68fad-5c1d-4c75-bee6-4fb18fafa1ec None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:01.197395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68fad-5c1d-4c75-bee6-4fb18fafa1ec None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:01.197395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68fad-5c1d-4c75-bee6-4fb18fafa1ec None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:01.199016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 395/790] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:01.205669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:01.206088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:01.206281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:01.239002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:01.240161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:01.259237 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 396/791] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:01 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:01.289522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c68fad-5c1d-4c75-bee6-4fb18fafa1ec None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:01.303898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c68fad-5c1d-4c75-bee6-4fb18fafa1ec None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:01.309462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:01.310037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:01.310315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:01.310578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:01.311240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:01.313104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:01.314494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.common [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 23 12:45:01.335910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.sql.core [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 23 12:45:01.335910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 23 12:45:01.335910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [parameters: {'id': 'bb33aec9c74442149dacf17a0c8e7e05', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 23 12:45:01.335910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66604) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 23 12:45:01.349580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb33aec9c74442149dacf17a0c8e7e05.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb33aec9c74442149dacf17a0c8e7e05. Nov 23 12:45:01.350845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 396/792] 10.222.0.60 () {60 vars in 1161 bytes} [Tue Nov 23 12:45:01 2021] POST /identity/v3/projects => generated 262 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:01.357668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:01.366790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5837e9-aee5-4e1f-9691-c15ae7dad0be None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:01.372621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:01.373421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:01.373734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:01.374010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:01.383710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:01.385732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:01.401074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-891d33c1-279a-46e9-89e1-a54f06235dd4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:01.402190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 397/793] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:01.413431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:01.429764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3023d1-2b95-40a3-8464-5fb03eef1afd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:01.437216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:01.437844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:01.438141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:01.438422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:01.439201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:01.439505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:01.441821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a788068-4220-4b73-90d6-ea23b082a5ea admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:01.460263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 397/794] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:01 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:03.588630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102918-620e-408f-a1f3-fa0d2b27e78e None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:03.589532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102918-620e-408f-a1f3-fa0d2b27e78e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:03.589532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102918-620e-408f-a1f3-fa0d2b27e78e None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:03.592202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 398/795] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:03.600722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:03.601142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:03.601249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:03.632507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:03.634021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:03.642658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 398/796] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:03 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:03.667690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102918-620e-408f-a1f3-fa0d2b27e78e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:03.681844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102918-620e-408f-a1f3-fa0d2b27e78e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:03.686574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:03.687159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:03.687443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:03.687787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:03.688476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:03.690307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:03.691639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.common [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 23 12:45:03.706151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.sql.core [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 23 12:45:03.706151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 23 12:45:03.706151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [parameters: {'user_id': '2c611c37a7d94e9db6733314822aeb17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 23 12:45:03.706151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 23 12:45:03.722502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 23 12:45:03.723786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 399/797] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:45:03 2021] POST /identity/v3/users => generated 160 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:45:03.732636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:03.745473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d69f-51c4-4b52-8070-de4196bf0fe6 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:03.751136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:03.751893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:03.752183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:03.752506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:03.765852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:03.767898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:03.786465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-c102ddb4-e850-40cb-b6bb-a2215fcf8ff2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 12:45:03.787584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 399/798] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:45:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:03.795377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:03.811888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05637-2fa9-4c5c-beae-ad8a22bf88e7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:03.816822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:03.817431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:03.817717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:03.818002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:03.818835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:03.819147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:03.821305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbb3a1-0ef6-4494-81b8-2ccc870f7d40 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:03.855196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 400/799] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Nov 23 12:45:03 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:06.156357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f0e8-2430-4958-9bc8-19ea9f847a38 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:06.157137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f0e8-2430-4958-9bc8-19ea9f847a38 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:06.157137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f0e8-2430-4958-9bc8-19ea9f847a38 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:06.159788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 400/800] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:06.167730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:06.168412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:06.168516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:06.191121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:06.192706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:06.201225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 401/801] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:06 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:45:06.236914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f0e8-2430-4958-9bc8-19ea9f847a38 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:06.251406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f0e8-2430-4958-9bc8-19ea9f847a38 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:06.256078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:06.256816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:06.257098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:06.257371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:06.272356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:06.274558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:06.292164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:06.293870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 401/802] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:06.300982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:06.314593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f0047-87d2-457e-9015-ab994bcad0ec None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:06.323144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:06.323764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:06.324052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:06.324428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:06.325130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:06.325432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:06.327035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5521e3-fd42-4db2-bfe3-83ef53351205 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:06.340856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 402/803] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:06.346954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:06.357414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52914-8aad-41c8-a8e6-fc0815b422c2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:06.362825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:06.363406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:06.363690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:06.363967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:06.364666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:06.366544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1b7a-512d-4aac-abb6-4d9b091bef01 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:06.389875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 402/804] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:45:06 2021] POST /identity/v3/users => generated 249 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:08.525642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec88b3-e403-476a-97fa-189115b88acc None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.526188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec88b3-e403-476a-97fa-189115b88acc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.526188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec88b3-e403-476a-97fa-189115b88acc None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.528927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 403/805] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:08.536943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.537404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.537492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.561846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:08.563078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:08.570252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 403/806] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:08 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:45:08.595726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec88b3-e403-476a-97fa-189115b88acc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.613322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec88b3-e403-476a-97fa-189115b88acc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.619267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.619987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.620270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.620562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.632683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:08.639233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:08.640335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 404/807] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:08.649752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.664688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8767-4b60-4998-807d-24ffd43e498d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.670444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.671058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.671280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.671549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.672279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:08.672573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.674150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.683583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 404/808] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:08.690138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.704072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998bff-4edf-4f84-a6d2-f1615ee74ef7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.709715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.710450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.710737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.711008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.723329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.725227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.743101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:08.744184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 405/809] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:08.753559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.766555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5da9-a2d4-4509-abab-78bfe5c0ff74 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.772384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.772957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.773235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.773504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.774530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:08.774823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.776491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.789716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 405/810] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:08.796939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.806941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982652b-a899-4314-82ae-e3227b478ad6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.813121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.813857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.814140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.814558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.830994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.833052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.852653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 12:45:08.853835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 406/811] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:08.861156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.875836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48385bb-76f9-47ab-bbd7-75e7dc665853 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.881636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.882245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.882521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.882796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.883598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:08.883895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.885778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.916882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1160 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:08.923479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.933920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586075-a003-4fdb-9b7b-30982fbfb702 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.939058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.939633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.939916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.940192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.948790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.950583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:08.960289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 407/813] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:08.966378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:08.976700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf7e3-f797-41b3-a14a-ac75a1a12b07 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:08.982190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:08.982960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:08.983266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:08.983606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:08.996744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:08.998978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:09.018262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:09.019441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 407/814] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:09.026058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:09.035147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426bfb-0677-4089-90ca-bbe25e820912 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:09.039982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:09.040618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:09.040903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:09.041180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:09.041891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:09.042194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:09.043810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:09.056616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 408/815] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:09.062638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:09.072810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e479c-728a-4b5f-9c4b-d07a0d0f6e0d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:09.078065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:09.078792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:09.079067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:09.079342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:09.088650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:09.090597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:09.105093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:09.106237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 408/816] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:09.113113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:09.123547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b8dd-bfb3-4718-84a0-458326511c3c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:09.129311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:09.129940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:09.130222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:09.130498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:09.131258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:09.131677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:09.133636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d956-3757-44e2-9043-afbb9ef75507 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:09.149989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 409/817] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:09.156492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:09.166706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead42c4-a0a5-4524-9477-f79a56ac5b67 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:09.171492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:09.172063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:09.172382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:09.172656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:09.173480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=326b9ed23f5a43d6bb57a386c688c873) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:09.173724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:09.175607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40fd6-1e4c-4bfa-a343-5f4f1efef5ab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:09.181255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 409/818] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:09 2021] GET /identity/v3/role_assignments?user.id=326b9ed23f5a43d6bb57a386c688c873&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.284536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8c53-d0e0-41a1-8742-7b064bc337fb None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.285084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8c53-d0e0-41a1-8742-7b064bc337fb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.285199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8c53-d0e0-41a1-8742-7b064bc337fb None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.287893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 410/819] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:11.296488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.296985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.297068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.325212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:11.326459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:11.333912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 410/820] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:11 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:11.360403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8c53-d0e0-41a1-8742-7b064bc337fb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.375195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8c53-d0e0-41a1-8742-7b064bc337fb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.381060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.382115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.382399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.382703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.396931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:11.405395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:11.406926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 411/821] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:11.414561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.425220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a0d41-b7b6-45c7-b4dd-ba6453c4d78c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.431530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.432413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.432847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.433265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.434089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:11.435513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.438812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.450407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 411/822] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.456774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.467962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08eefc-58ed-4619-957c-821fdd1952b2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.473310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.474084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.474390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.476162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.488884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.490765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.512454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:11.513739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 412/823] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:11.520325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.532695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aece-196a-46b4-9554-dd30ab5b4924 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.541032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.542361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.543183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.543639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.544676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:11.545282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.547236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.562292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 412/824] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.569955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.588217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfabb-6ba2-432f-8b07-35eda6759fd8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.595716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.596994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.597486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.597955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.623127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.626827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.662820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 12:45:11.664807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 413/825] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/users/neutron => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:11.673461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.687301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b898-a99c-4496-9c45-883a4b916bde admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.693253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.693253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.693253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.694672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.696965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:11.696965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.697351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.733563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 413/826] 10.222.0.60 () {56 vars in 1160 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.743172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.755063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5929-9145-4b1f-a4fa-84634b5525ac admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.761983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.763145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.763575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.764020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.780414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.783028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.809178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:11.810286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 414/827] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:11.816558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.827601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973364e-b708-423d-a9b8-36a7db24237e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.832670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.833279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.833566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.833838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.834538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:11.834834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.836508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.851831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 414/828] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.858092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.871300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7ffb-4084-405e-abab-321d341e0f7d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.877180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.878532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.878532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.878532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.888895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.890916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.910002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:11.911223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 415/829] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:11.923226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.934264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb8d28-b69d-4b8b-a10f-d5a6b55632c5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.940602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.941196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.941456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.941727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:11.942497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:11.942789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:11.944699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c44a47-6cef-4b5f-8a3d-1ea7955c82f1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:11.959382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 415/830] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:11.966281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:11.980269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d634-e131-4c7e-914f-1ec0d7fdeea3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:11.985684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:11.986516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:11.986806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:11.987079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/326b9ed23f5a43d6bb57a386c688c873/roles/852684ea01d74d47b176096f6297c602` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:12.010139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=326b9ed23f5a43d6bb57a386c688c873, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:12.015148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa219e-4b72-4f99-b04b-7af3df47cd42 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:12.032753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 416/831] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:45:11 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/326b9ed23f5a43d6bb57a386c688c873/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:45:14.133253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8742c-bd51-4511-8ef0-9b5026223a10 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.133839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8742c-bd51-4511-8ef0-9b5026223a10 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.133839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8742c-bd51-4511-8ef0-9b5026223a10 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.135427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 416/832] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:14.141658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.142253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.142253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.168390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:14.169615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:14.237201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 417/833] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:14 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:14.260588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8742c-bd51-4511-8ef0-9b5026223a10 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.274396 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8742c-bd51-4511-8ef0-9b5026223a10 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.279741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.280586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.280871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.281147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.293042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:14.299547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:14.300704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 417/834] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:14.306978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.316611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cd47c-7413-40be-98bf-f3d25d524792 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.321893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.322503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.322791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.323070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.323786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.324086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.325749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.335015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 418/835] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:14.341038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.351377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051f71e-c296-4aa1-8976-3679815b8375 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.356118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.356850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.357132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.357475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.369192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.371039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.388679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:14.389719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 418/836] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:45:14.395706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.406724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ea74-0ec0-4949-a996-5cf111d85060 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.411527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.412120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.412432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.412705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.413378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.413702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.415320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.428659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 419/837] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:45:14.434623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.444906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abb25-a5aa-4b35-82b7-771d3b86323c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.450009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.450733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.451017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.451425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.464766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.466775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.485365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 12:45:14.486511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 419/838] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:14.492660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.502649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347425a3-ae05-43bf-9081-daacd5afe0a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.507815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.508447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.508728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.509002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.509791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.510090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.511946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.543141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 420/839] 10.222.0.60 () {56 vars in 1160 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:14.549256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.559279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505c0f3-0cd1-4edb-a2b1-6a11f4305a22 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.565176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.565746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.566025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.566300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.574815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.576679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.586185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 420/840] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:14.592692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.602825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803af00-f49c-4c59-ab4b-a6344d51f9f2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.607658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.608520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.608812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.609092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.621533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.623692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.643196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:14.644293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 421/841] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:14.650678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.659619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772fd0-d960-490c-a12b-50a544fc5112 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.665186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.665773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.666049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.666319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.666993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.667287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.668883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.682051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 421/842] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:14.688112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.698140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-e038-460c-9789-e59c27fc6895 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.703473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.704252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.704524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.704785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.713810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.715757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.729536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:14.730637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 422/843] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:14.737048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.747347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd8db2-fad4-49ac-ac43-26334ea7eb35 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.753170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.753907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.754191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.754472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.755223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.755521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.757397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ac5bb-d2f7-4ec2-92df-9e436ede9b9e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.770850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 422/844] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:14.777473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:14.792464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0818bf-96bc-4a1c-a145-fc5ac4375a34 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:14.799669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:14.800603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:14.800994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:14.801385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:14.802369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=326b9ed23f5a43d6bb57a386c688c873) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:14.802733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:14.804707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0c67-ee4b-4715-87ea-c9df919eda7c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:14.811477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 423/845] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:14 2021] GET /identity/v3/role_assignments?user.id=326b9ed23f5a43d6bb57a386c688c873&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:16.931679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f38d-3625-4e07-9f05-39e6930de3fb None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:16.932225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f38d-3625-4e07-9f05-39e6930de3fb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:16.932225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f38d-3625-4e07-9f05-39e6930de3fb None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:16.933951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 423/846] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:16.939923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:16.940507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:16.940507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:16.967559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:16.968785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:16.986149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 424/847] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:16 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:17.009384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f38d-3625-4e07-9f05-39e6930de3fb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:17.025276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f38d-3625-4e07-9f05-39e6930de3fb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:17.029885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:17.030603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:17.030887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:17.031164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] PATH_INFO: `/v3/services/network` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:17.031794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:17.033417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:17.045246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 12:45:17.046484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 424/848] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:17 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:17.052751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:17.061991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b2dc-0eb0-49e7-b0bf-09261ed16302 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:17.067421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:17.068033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:17.068381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:17.068662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:17.069349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] RBAC: Adding query filter params (name=network) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:17.069647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:17.071685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc700-7c58-4981-8752-07ff1c7bc50f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:17.078970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 425/849] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:17 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:17.090295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:17.102020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021c65-74ef-4c9d-a04d-6f6362f1103e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:17.108168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:17.108907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:17.109192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:17.109468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:17.110180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:17.110473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:17.112197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0ba30-a55d-40fe-9a26-ebb4c57fe945 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:17.118229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 425/850] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:17 2021] GET /identity/v3/services?type=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:19.242872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0f258-9780-4ce6-b4e9-127d5f0008af None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:19.243426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0f258-9780-4ce6-b4e9-127d5f0008af None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:19.243426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0f258-9780-4ce6-b4e9-127d5f0008af None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:19.245180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 426/851] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:19.251197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3287-70fd-4fdf-a7fd-03be1445714e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:19.251715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3287-70fd-4fdf-a7fd-03be1445714e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:19.251823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d3287-70fd-4fdf-a7fd-03be1445714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:19.275571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-783d3287-70fd-4fdf-a7fd-03be1445714e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:19.276773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-783d3287-70fd-4fdf-a7fd-03be1445714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:19.285214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 426/852] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:19 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:19.309003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0f258-9780-4ce6-b4e9-127d5f0008af None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:19.322287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0f258-9780-4ce6-b4e9-127d5f0008af None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:19.327658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:19.328259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:19.328558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:19.328829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:19.329541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:19.331162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca249f7-e848-48b0-bb89-25528a1e9f9e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:19.346569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 427/853] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:45:19 2021] POST /identity/v3/services => generated 240 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:21.481537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031086-b799-4d34-a906-7e26740d7aeb None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.482171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031086-b799-4d34-a906-7e26740d7aeb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.482171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031086-b799-4d34-a906-7e26740d7aeb None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.483778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 427/854] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:21.490016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.490514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.490677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.515195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:21.516395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:21.536628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 428/855] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:21 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:21.560008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031086-b799-4d34-a906-7e26740d7aeb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:21.573980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031086-b799-4d34-a906-7e26740d7aeb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:21.579271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:21.580011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.580335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.580611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.581284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:21.582989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:21.594063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 12:45:21.595217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 428/856] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:21 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:21.602006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:21.612657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e78c0-24ba-401b-b46d-b4c9e0f8fa42 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:21.618012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:21.618635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.618914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.619186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.619865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:21.620154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:21.621831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:21.629357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 429/857] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:21 2021] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:21.635370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:21.645272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a512599-1d4f-4418-9c81-f919eb1f97b1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:21.650047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:21.650631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.650889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.651155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.651857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] RBAC: Adding query filter params (type=network) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:21.652137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:21.653766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:21.660266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 429/858] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:21 2021] GET /identity/v3/services?type=network => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:21.666768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:21.677235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1727f-7b14-4311-8d2d-5dbe5c037401 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:21.682358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:21.683061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.683341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.683615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.684427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] RBAC: Adding query filter params (interface=public, service_id=36b2715a3ae0430fac5542fdee77edd5, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:21.684733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:21.686925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9da1ea-2c96-469b-8f7e-ba83ea85bfd6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:21.693262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 430/859] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:45:21 2021] GET /identity/v3/endpoints?service_id=36b2715a3ae0430fac5542fdee77edd5&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:21.699935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:21.711389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a543c5-dd6e-49d9-ad4a-24e4e257656a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:21.716960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:21.717579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:21.717869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:21.718150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:21.718834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:21.720548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6afef-255e-4443-80a2-7ac6080f6d6a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:21.728471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 430/860] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:45:21 2021] GET /identity/v3/services => generated 1967 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:45:23.849930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1f02-7b72-4766-9c81-54b7c8753434 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:23.850489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1f02-7b72-4766-9c81-54b7c8753434 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:23.850489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1f02-7b72-4766-9c81-54b7c8753434 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:23.852218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 431/861] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:23.858049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:23.858537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:23.858629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:23.885239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:23.886374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:23.894531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 431/862] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:23 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:23.917870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1f02-7b72-4766-9c81-54b7c8753434 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:23.931893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1f02-7b72-4766-9c81-54b7c8753434 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:23.936717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:23.937453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:23.937749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:23.938030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] PATH_INFO: `/v3/services/network` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:23.938662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:23.940331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:23.951486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 12:45:23.952705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 432/863] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:23 2021] GET /identity/v3/services/network => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:23.959117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:23.972332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8607-cbb7-48ae-9dc2-63f283cd2ea7 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:23.976951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:23.977577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:23.977859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:23.978132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:23.978808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:23.979099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:23.980717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:23.986285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:23 2021] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:23.992705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:24.003602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bdb9-bf00-4f98-97b0-4af02ecca85a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:24.008796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:24.009402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:24.009688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:24.009969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:24.010645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:24.010946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:24.012596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91d09-01ac-4eea-824f-2fc31f698631 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:24.018390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Nov 23 12:45:23 2021] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:24.025589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:24.041970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe92e-a2cb-41a2-9257-497adba391f2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:24.048696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:24.049324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:24.049605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:24.049881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:24.050587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:24.052213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b41cc-e4bd-48d0-bafc-ef8a1f8c0b00 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:24.080020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 433/866] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:45:24 2021] POST /identity/v3/endpoints => generated 327 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:26.350917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e352-c01c-4af3-9163-e04e22551239 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:26.351523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e352-c01c-4af3-9163-e04e22551239 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:26.351523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9e352-c01c-4af3-9163-e04e22551239 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:26.353224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 434/867] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:26.359093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:26.359539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:26.359622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:26.381990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:26.383121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:26.403501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 434/868] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:26.431119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e352-c01c-4af3-9163-e04e22551239 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:26.444892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9e352-c01c-4af3-9163-e04e22551239 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:26.449723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:26.450337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:26.450626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:26.451063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:26.451778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:26.453395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:26.460436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.sql.core [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 23 12:45:26.460436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 23 12:45:26.460436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [parameters: {'id': '8692182c5ab249db931084d9beb621bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 23 12:45:26.460436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Nov 23 12:45:26.466443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 23 12:45:26.467636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 435/869] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:45:26 2021] POST /identity/v3/roles => generated 144 bytes in 37 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:26.474139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:26.483506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0375ea2-f3c9-42b3-a0e8-f127c9f9797d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:26.488963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:26.489719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:26.490007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:26.490277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:26.502808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:26.509357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-4a92ab81-c4b7-4eaa-b033-eb09285fe88e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 12:45:26.510528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Nov 23 12:45:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:26.517077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:26.529252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ac16-fb56-406d-bfa7-483f1e11b27a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:26.537608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:26.538479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:26.538898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:26.539305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:26.540464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:26.540930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:26.543223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68147103-771c-43fc-9a90-61f29cece59b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:26.553093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 436/871] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:28.662288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2df2-6604-4a20-b8f9-980cfa0e19b2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:28.662849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2df2-6604-4a20-b8f9-980cfa0e19b2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:28.662849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2df2-6604-4a20-b8f9-980cfa0e19b2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:28.664578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 436/872] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:28.669924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:28.670375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:28.670466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:28.693178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:28.694333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:28.702169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 437/873] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:28.726776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2df2-6604-4a20-b8f9-980cfa0e19b2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:28.740830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2df2-6604-4a20-b8f9-980cfa0e19b2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:28.745535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:28.746256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:28.746542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:28.746814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:28.766210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:28.768067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:28.787653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:28.788825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 437/874] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:28.795761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:28.805046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68e18f-a76d-40da-9145-4ed9e69c9424 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:28.810664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:28.811277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:28.811563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:28.811843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:28.812560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:28.812864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:28.814520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe33ab-2d4c-4cf0-88a2-ac05151b4f0c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:28.830163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 438/875] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:28.836301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:28.846263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048f0e1-398d-46c6-b45a-dd019b641f18 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:28.850995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:28.851597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:28.851597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:28.852147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:28.852861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:28.854782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4f28-269c-4565-a899-4f48e8ebaa32 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:28.876258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 438/876] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:45:28 2021] POST /identity/v3/users => generated 247 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:30.982663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3929e-97c9-44d8-858b-991fb9bbf585 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:30.983379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3929e-97c9-44d8-858b-991fb9bbf585 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:30.983379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3929e-97c9-44d8-858b-991fb9bbf585 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:30.985329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 439/877] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:30.991035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:30.991499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:30.991607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.017403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:31.018548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:31.027507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 439/878] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:31.051075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3929e-97c9-44d8-858b-991fb9bbf585 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.065323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3929e-97c9-44d8-858b-991fb9bbf585 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.070272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.070997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.071286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.071567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.084175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:31.090520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:31.092648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 440/879] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:31.099127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.108469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc8d2-9861-443a-bf3a-7b3d213ea3b5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.114228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.114822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.115182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.115370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.116082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.116409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.118114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.126998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 440/880] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:31.133913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.150088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2925-77d8-4ee1-a049-28b083bc7e1c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.154324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.155066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.155347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.155625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.167303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.169190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.186537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:31.187637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 441/881] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:31.194079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.204353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407305-af6e-40fc-a420-3c7a2aa09bd1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.209649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.210234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.210518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.210780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.211492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.211785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.213455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.226753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 441/882] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:31.232791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.242914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f1e5-17b7-4f52-b017-9f64cdceccee admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.248400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.249121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.249400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.249671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.263330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.265443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.283758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:31.284885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 442/883] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:31.291210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.301386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc319f8-72e6-4f6b-801a-f55da8c4264f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.306890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.307481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.307759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.308034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.308869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.309169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.311409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.341201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 442/884] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:31.347348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.357425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5663bf-e8e8-4903-9980-252ce99bf3af admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.362783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.363370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.363649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.363921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.372108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.374002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.383170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 443/885] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:31.389256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.399598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e522b91-7e7e-4119-a527-99b64305b591 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.405261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.405980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.406270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.406546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.418650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.420802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.438720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:31.439850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 443/886] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:31.446075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.455291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97de9-31b9-4a90-82e2-fa98f11e0053 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.460650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.461213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.461499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.461778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.462465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.462824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.464398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.477348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 444/887] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:31.483259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.493439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821826f-1796-4182-9606-d8aa8bf6cc7e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.499233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.499948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.500268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.500538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.510009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.512008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.531502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:31.532724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 444/888] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:31.539669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.551034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c0885-ec42-4b0d-81f9-4bdcdfc91bcb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.556562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.557161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.557437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.557711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.558444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.558735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.561103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1527-db9b-4910-b024-06925a11e0be admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.576989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 445/889] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:31.583641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:31.594817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2026e8-f01c-4726-9376-84a63d882df9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:31.600494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:31.601059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:31.601315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:31.601588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:31.602394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:31.602759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:31.604892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b1d58-6944-4606-bcbc-3444a695a214 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:31.610898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 445/890] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:31 2021] GET /identity/v3/role_assignments?user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:33.662285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db9a5-30f6-4d2e-a723-88e455200619 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.662879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db9a5-30f6-4d2e-a723-88e455200619 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.662879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db9a5-30f6-4d2e-a723-88e455200619 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.664540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 446/891] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:33.669854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.670321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.670426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.693515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:33.694695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:33.703437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 446/892] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:33.726970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65db9a5-30f6-4d2e-a723-88e455200619 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.739910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65db9a5-30f6-4d2e-a723-88e455200619 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.744756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.745482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.745761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.746042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.759205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:33.765671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:33.766807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 447/893] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:33.773693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.783520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7234d6b-2843-4142-9716-30fb51e19c84 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.789249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.789835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.790124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.790396 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.791165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:33.791468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:33.793296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:33.803081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 447/894] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:33.809222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.819843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db38d87-f00d-415a-98b9-066c658694df admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.826241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.826972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.827250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.827521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.839936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:33.841997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:33.865174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:33.866345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 448/895] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:33.872528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.882150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d43d0-5d57-4b15-9a1c-ed81ebbfff42 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.886643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.887254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.887535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.887812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.888617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:33.888921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:33.890490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:33.903940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 448/896] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:33.909978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.919944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754195a-700f-4c0c-896a-7265a01ba7fa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.924711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.925433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.925812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.925986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.939117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:33.941197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:33.959051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:33.960146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 449/897] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:33.966385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:33.976146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc32fee-a93f-41a2-be26-218a1703cafb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:33.981207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:33.981886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:33.982164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:33.982455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:33.983253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:33.983556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:33.985453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.014871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 449/898] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:34.020919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:34.031924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d399-2369-4e93-ae96-e926f51785f2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:34.037075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:34.037800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:34.038072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:34.038353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:34.050788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:34.052720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.069699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:34.070850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 450/899] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:34.077358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:34.087931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0faa6-2c06-44ca-8485-1238a2c30e16 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:34.093598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:34.094186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:34.094468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:34.094738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:34.095418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:34.095712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:34.097342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.111720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 450/900] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:34.118029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:34.128731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86443-9d7b-4f49-90e0-51b8c3109e06 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:34.133459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:34.134178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:34.134456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:34.134734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:34.144540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:34.146508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.160863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:34.161988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 451/901] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:34.168343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:34.180426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b96b73-be83-4448-938c-45cf00def349 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:34.187304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:34.187899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:34.188193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:34.188502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:34.189255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:34.189558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:34.191392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4381b-37ac-4aa7-89ed-e4550ff82906 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.207322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 451/902] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:34.213820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:34.224110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80dace-beb0-46ea-acd7-f797bb5816ad admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:34.228721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:34.229539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:34.229818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:34.230096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/bb1451a2dbfe4b68a48d1dd9a31c09cf/roles/852684ea01d74d47b176096f6297c602` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:34.251992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=bb1451a2dbfe4b68a48d1dd9a31c09cf, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:34.255279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa04e3-e633-42a9-813a-ffbcf9b12914 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:34.270620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 452/903] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:45:34 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/bb1451a2dbfe4b68a48d1dd9a31c09cf/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:45:36.331810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ecc2-ab79-4936-9dfa-c65610df5734 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.332400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ecc2-ab79-4936-9dfa-c65610df5734 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.332400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ecc2-ab79-4936-9dfa-c65610df5734 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.334083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 452/904] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:36.339630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.340076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.340166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.364959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:36.366229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:36.438518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 453/905] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:36.462240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ecc2-ab79-4936-9dfa-c65610df5734 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.475515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ecc2-ab79-4936-9dfa-c65610df5734 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.479801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.480534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.480842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.481115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.493667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:36.500426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:45:36.501596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 453/906] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:36.507908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.519520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41f1d-287b-44ea-bda1-61f5c4811d06 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.525233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.525807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.526119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.526388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.527106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:36.527401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.529538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.538336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 454/907] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:36.544638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.555028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481752a-be07-436a-a112-49af5c0e1e90 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.559620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.560459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.560746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.561021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.572894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.574753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.592910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:36.594000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 454/908] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:36.600175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.610349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ace9-0207-4b11-bab1-5b128ac54f92 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.615066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.615645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.615934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.616191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.616916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:36.617215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.618844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.631948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 455/909] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:36.638019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.648704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab314d-8ad1-490e-891b-9ea1ea13c954 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.654466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.655184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.655462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.655740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.669224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.671243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.689902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:36.691018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 455/910] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:36.697260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.707138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548e2b9-ca63-4af0-bf6d-8bf6ba5177d6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.711877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.712518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.712792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.713070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.713861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:36.714152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.716213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.748083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 456/911] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:36.754210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.764023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a419-f563-455d-ac38-3a25c85c8f43 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.768828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.769386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.769665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.769936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.778007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.779860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.789127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 456/912] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:36.795950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.808999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ccce-cd2b-474a-b6e4-6874b68638e0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.818596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.819328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.819608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.819881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.833322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.835177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.853050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:36.854210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 457/913] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:36.861033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.870600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9607dc-bea8-49b0-857b-02662e4e7f7d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.876573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.877174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.877453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.877719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.878400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:36.878692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.880320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.894676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 457/914] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:36.901294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.911476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3600cc-14dd-4890-b97c-02b4c0840b69 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.916157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.916898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.917174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.917443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.926494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.928499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.941973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:36.943038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 458/915] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:45:36.949440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.959660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369163-01c9-4529-a1cb-4e0a84b7f9f4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:36.964441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:36.965007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:36.965285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:36.965553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:36.966493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:36.966785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:36.968649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ff5-41c6-4925-9f2d-76dbe62bd465 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:36.981365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 458/916] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:36.987730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:36.997771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd995a9-d666-4b62-b7f5-b580eeaa58c7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:37.003131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:37.003706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:37.003991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:37.004280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:37.005075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:37.005376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:37.007224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf37dd-cc8f-4e78-baf4-3d72aabb157f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:37.013212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 459/917] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:36 2021] GET /identity/v3/role_assignments?user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:39.140094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5861-bb2f-4d31-bccd-90b6adde8cf9 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.140684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5861-bb2f-4d31-bccd-90b6adde8cf9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.140684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5861-bb2f-4d31-bccd-90b6adde8cf9 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.142292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 459/918] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:39.147579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.148022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.148459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.170723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:39.171882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:39.179291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 460/919] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:39.202819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf5861-bb2f-4d31-bccd-90b6adde8cf9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.217885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf5861-bb2f-4d31-bccd-90b6adde8cf9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.223107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.223818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.224095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.224448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.237015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:39.243124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:45:39.244254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 460/920] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:39.250521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.259707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769e55-a7f6-4749-86cf-f031ceed8da5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.265493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.266097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.266377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.266654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.267396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.267694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.269332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.279257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 461/921] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:39.285771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.296268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3da3f-21af-427a-bcb1-35d2d4224a5a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.301412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.302120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.302400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.302673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.314834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.316694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.333926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:39.335044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 461/922] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:39.341144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.351372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8be0b3-460f-4251-a3d5-18e5d1631ec1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.357258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.357872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.358154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.358422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.359123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.359422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.361074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.374357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 462/923] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:39.380431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.390727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fa740-ed3e-4be8-a63e-017122c4ab03 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.396226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.396983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.397262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.397534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.411389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.413431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.431593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:39.432755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 462/924] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:39.439354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.450155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e465c6-df29-4b8f-be0e-df9e3fcf2190 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.455811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.456466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.456754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.457031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.457844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.458142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.460044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.491950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 463/925] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:39.498518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.508680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63632-9b25-4e01-ad2d-afb266a297c4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.514278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.514854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.515132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.515459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.524533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.526265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.535726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 463/926] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:39.542082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.552524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bb2da-2a65-4ef3-9c7c-791039947239 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.558232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.559010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.559296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.559965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.573523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.575480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.593643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:39.594756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 464/927] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:39.600977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.609986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189df17-d1d0-430a-b095-e30e6b4aa621 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.615300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.615900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.616177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.617643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.618375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.618672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.620262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.635627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 464/928] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:45:39.641915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.652387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524378b-f57a-44aa-ac92-40e9aaa36333 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.657950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.658686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.658969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.659240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.668603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.670782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.684916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:39.686052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 465/929] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:39.692383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.702685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc39ce-f329-4627-a41b-5a699d802c6e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.708116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.708741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.709028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.709334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.710118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.710448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.712340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e544f9-eb69-4d44-9b9b-e0fb02dd4787 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.727100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 465/930] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:39.733607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:39.743434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659596a4-5a32-4dad-9d04-fb52057b399a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:39.748143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:39.748777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:39.749060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:39.749338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:39.750122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:39.750420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:39.752327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884451-049d-4db9-8e3b-188e6d37706f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:39.757851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 466/931] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:39 2021] GET /identity/v3/role_assignments?user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:41.863570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66e63-9bf7-4c9f-855d-2420752d5ca0 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:41.864153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66e63-9bf7-4c9f-855d-2420752d5ca0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:41.864153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66e63-9bf7-4c9f-855d-2420752d5ca0 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:41.866161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 466/932] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:41.872271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:41.872758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:41.872848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:41.896188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:41.897384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:41.907381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 467/933] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:41.930806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66e63-9bf7-4c9f-855d-2420752d5ca0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:41.944416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66e63-9bf7-4c9f-855d-2420752d5ca0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:41.949177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:41.949887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:41.950203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:41.950504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:41.963090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:41.969302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:45:41.970428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 467/934] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:41.977008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:41.986265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6d3d-32ce-4d36-87ad-206e1250715f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:41.991890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:41.992526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:41.992812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:41.993090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:41.993801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:41.994075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:41.995708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.005384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 468/935] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:45:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:42.011728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.022712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557112-0b81-49ff-b47f-bb5081bdea99 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.027780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.028735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.029017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.029275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.041390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.043221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.061152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:42.062467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 468/936] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:42.068887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.079400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992ef0-686f-40a3-94a7-cdab5341b63b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.085148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.085743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.086094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.086313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.087016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:42.087311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.088989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.103066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 469/937] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:42.109645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.119694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4803e9a-0a86-4c77-a18c-28416790bf4b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.124345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.125077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.125353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.125624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.139264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.141346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.159788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:42.160968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 469/938] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:45:42.167192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.179106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ce67-ef30-406d-9ccb-e9df26b336e1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.183535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.184127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.184606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.184842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.185509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:42.185813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.187697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.219145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 470/939] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:42.225227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.235151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f50a1-46b9-4efd-ad2a-2104006cd0e4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.239994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.240760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.241041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.241314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.254530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.256408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.274861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:42.276025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 470/940] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:42.282369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.295429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53aea0-e43b-4459-acfb-e1ba0d73640a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.301084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.301701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.301991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.302265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.302989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:42.303283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.304950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.318566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 471/941] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:42.325922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.335738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac7abf-f92a-4f68-82c4-8881e24efff7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.341388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.342041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.342636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.342636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.351905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.353891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.368096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:42.369298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 471/942] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:42.375694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.385874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ef77-4d90-42c4-9404-21877bb965b0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.391725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.392347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.392631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.392907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.393653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:42.393949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.395801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126718-ea52-4f65-992b-30a8c29d56fa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.410386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 472/943] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:45:42.416794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:42.426711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9630-2928-42ff-9d7b-acdb535ffd53 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:42.431379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:42.432180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:42.432487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:42.432748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/bb1451a2dbfe4b68a48d1dd9a31c09cf/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:42.434770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=bb1451a2dbfe4b68a48d1dd9a31c09cf, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:42.437518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be14d-473f-41e1-addd-85055fba95d4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:42.453563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 472/944] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:45:42 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/bb1451a2dbfe4b68a48d1dd9a31c09cf/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:45:44.533728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea687-f325-4b63-88a3-80d3b7d678ba None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.534364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea687-f325-4b63-88a3-80d3b7d678ba None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.534364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea687-f325-4b63-88a3-80d3b7d678ba None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.535979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 473/945] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:44.541424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.541880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.541979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.566235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:44.567434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:44.636346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 473/946] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:44.660507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea687-f325-4b63-88a3-80d3b7d678ba None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.674052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea687-f325-4b63-88a3-80d3b7d678ba None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.679280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.680010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.680287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.680579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.692877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:45:44.699032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:45:44.700201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 474/947] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:44.706756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.716184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5ddec-6ae4-4a53-b58e-0064893a8a99 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.721733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.722323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.722688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.722984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.723698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:44.723995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.725636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.734713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 474/948] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:44.740840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.751455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f7a3-5310-496c-afcb-2ffa42269380 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.757010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.757734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.758012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.758272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.770726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.772617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.790338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:44.791372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 475/949] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:44.797672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.807839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d287b-f17c-4f15-b792-4bf7fd0dd62b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.813850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.814433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.814718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.814998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.815683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:44.815981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.817599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.830944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 475/950] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:44.837178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.847403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2596-c19d-4a2d-b269-83e02cd7194d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.852702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.853442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.853733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.854008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.867355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.869501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.887959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 12:45:44.889143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 476/951] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:44.895852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.907132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599a15-0a7a-4f55-9e44-507d6e19b6ad admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.912584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.913203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.913482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.913748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.914539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:44.914836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.916691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.946970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 476/952] 10.222.0.60 () {56 vars in 1156 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:44.953669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:44.964115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713677dc-41ab-420d-bc10-e69febcdfbc2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:44.969764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:44.970335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:44.970621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:44.970899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:44.979290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:44.981091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:44.990560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 477/953] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:45:44.996785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:45.007146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247624e-884c-4085-9aa7-eed6d529a556 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:45.012822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:45.013700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:45.013980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:45.014255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:45.029356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:45.031219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:45.049859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:45:45.050923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 477/954] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:45:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:45.057357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:45.066571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc790f-9684-4727-ad39-d14cfa56887e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:45.072276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:45.072873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:45.073152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:45.073427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:45.074111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:45.074405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:45.076070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:45.089262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 478/955] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:45:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:45.095746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:45.105836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a9738-d9dd-4ed0-8850-423beb56b8fd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:45.111890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:45.112714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:45.112994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:45.113266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:45.123109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:45.125104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:45.140105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:45:45.141299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 478/956] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:45:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:45.147731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:45.158200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9340a7-bcf1-4326-85c5-2f0767687582 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:45.163719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:45.164338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:45.164619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:45.164887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:45.165627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:45.165937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:45.167771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922b55-de32-4af7-bd85-5cab4bcd16fb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:45.181461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 479/957] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:45:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:45.188765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:45.199675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e883-e63b-4bb8-a330-7746929aebfe admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:45.204862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:45.205431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:45.205715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:45.206048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:45.206824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:45.207134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:45.208965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126547e6-58d4-4ef5-8378-ec5005266a5a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:45.215083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 479/958] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:45:45 2021] GET /identity/v3/role_assignments?user.id=bb1451a2dbfe4b68a48d1dd9a31c09cf&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:47.303639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115c57-dda4-4d1f-8e0e-d01e277bf6b2 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:47.304185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115c57-dda4-4d1f-8e0e-d01e277bf6b2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:47.304185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115c57-dda4-4d1f-8e0e-d01e277bf6b2 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:47.305945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 480/959] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:47.311436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:47.311845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:47.311992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:47.334616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:47.335766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:47.343057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 480/960] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:47.365448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115c57-dda4-4d1f-8e0e-d01e277bf6b2 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:47.379779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115c57-dda4-4d1f-8e0e-d01e277bf6b2 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:47.384779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:47.385527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:47.385810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:47.386084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:47.386722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:47.388565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:47.399722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 12:45:47.400814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 481/961] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:45:47 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:47.407112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:47.415847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8ca42-244c-4aa7-a6aa-68b670520298 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:47.421336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:47.421932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:47.422221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:47.422504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:47.423216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:47.423520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:47.425116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1357ea-3bbf-4152-84ef-0a21a9032edc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:47.430081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 481/962] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:47 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:47.435915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:47.445861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c869-79e0-4c7a-b1f5-ee24d933b500 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:47.451113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:47.451701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:47.451982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:47.452280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:47.452950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:47.453241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:47.454827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beeae1-671d-4a2c-b5b5-5803725a0681 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:47.459632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 482/963] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:47 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:49.533124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1b7e-52e9-4305-a754-f102426d5654 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:49.534024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1b7e-52e9-4305-a754-f102426d5654 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:49.534024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1b7e-52e9-4305-a754-f102426d5654 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:49.535422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 482/964] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:49.541150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc082-c5e6-493b-8d21-0fd7db4afa3c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:49.541643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc082-c5e6-493b-8d21-0fd7db4afa3c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:49.541737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc082-c5e6-493b-8d21-0fd7db4afa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:49.566512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-29bdc082-c5e6-493b-8d21-0fd7db4afa3c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:49.567681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-29bdc082-c5e6-493b-8d21-0fd7db4afa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:49.576408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 483/965] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:49.600057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a1b7e-52e9-4305-a754-f102426d5654 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:49.614012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a1b7e-52e9-4305-a754-f102426d5654 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:49.618779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:49.619360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:49.619668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:49.619940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:49.620639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:49.622631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa534de-e79f-4dc8-84d9-88699687720f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:49.637820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 483/966] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:45:49 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:51.718320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc74eb-85fd-49ad-96da-4574f0d80bd4 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.718881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc74eb-85fd-49ad-96da-4574f0d80bd4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.718881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc74eb-85fd-49ad-96da-4574f0d80bd4 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.720614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 484/967] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:51.726331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.726813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.726901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.751198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:51.752403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:51.772391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 484/968] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:51 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:51.797031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc74eb-85fd-49ad-96da-4574f0d80bd4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:51.809749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc74eb-85fd-49ad-96da-4574f0d80bd4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:51.814583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:51.815337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.815625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.815904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.816563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:51.818173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:51.829422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 12:45:51.830572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 485/969] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:45:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:51.836938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:51.845827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828ad22-d4f8-4208-b7fa-f41c841b7e9a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:51.850678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:51.851259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.851538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.851812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.852523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:51.852825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:51.854426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:51.859531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 485/970] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:51.866356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:51.876395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886937ae-cdb2-4b1e-bae2-c96016cf4ea1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:51.880864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:51.881458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.881739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.882010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.882676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:51.882995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:51.884639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:51.889750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 486/971] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:51.895981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:51.906435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a38c-8601-4948-8e40-f60a2610a539 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:51.911777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:51.912401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.912689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.912964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.913714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] RBAC: Adding query filter params (interface=public, service_id=c9202fc9f191444794874c41aee69cd2, region_id=RegionOne) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:51.914014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:51.915604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f32714-3cb5-4553-8b98-e189d1dc1cb5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:51.921804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 486/972] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:45:51 2021] GET /identity/v3/endpoints?service_id=c9202fc9f191444794874c41aee69cd2&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:51.927685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:51.937746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6790f-bb03-45ad-b2e8-742d8f4b0d4f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:51.943017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:51.943619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:51.943908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:51.944181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:51.944855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:51.946447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c2a7-929f-4ef6-bdc4-b64d1be5f7cb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:51.953940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 487/973] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:45:51 2021] GET /identity/v3/services => generated 2196 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:45:54.058658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62236-cf83-442c-bb85-8cb48ef44947 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.059407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62236-cf83-442c-bb85-8cb48ef44947 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.059407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b62236-cf83-442c-bb85-8cb48ef44947 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.061024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 487/974] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:54.066621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.067077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.067191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.090484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:54.091641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:54.100556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 488/975] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:54 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:54.123772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b62236-cf83-442c-bb85-8cb48ef44947 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:54.136095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b62236-cf83-442c-bb85-8cb48ef44947 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:54.140510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:54.141256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.141540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.141819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.142458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:54.144068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:54.155614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 12:45:54.156843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 488/976] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:45:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:54.163418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:54.173883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d55d-35d2-4e08-9772-ff4706b59f6d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:54.179197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:54.179849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.180137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.180492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.181192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:54.181490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:54.183177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:54.189962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 489/977] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:54.196385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:54.207355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7a18c-28f1-4bee-9bec-47029ed5aa4c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:54.212922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:54.213528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.213810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.214084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.214778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:54.215065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:54.217121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cfc65-ee5a-4e5e-85b9-d44ef2a185e7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:54.223104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 489/978] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:54.229406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:54.239777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be15422-b4a5-4114-b84e-3e3b05192a59 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:54.250549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:54.251148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:54.251432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:54.251703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:54.252460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:54.254120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18318-5a59-40a8-8c5d-b1fab5c1b3c7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:54.275742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 490/979] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:45:54 2021] POST /identity/v3/endpoints => generated 349 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:45:56.385223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a863-67c2-4f31-a0a5-ee3694fbe489 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.385825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a863-67c2-4f31-a0a5-ee3694fbe489 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.385825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a863-67c2-4f31-a0a5-ee3694fbe489 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.387857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 490/980] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:56.393401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.393899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.393993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.417724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:56.419317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:56.438370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 491/981] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:56 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:56.467501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a863-67c2-4f31-a0a5-ee3694fbe489 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:56.480719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a863-67c2-4f31-a0a5-ee3694fbe489 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:56.485769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:56.486496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.486775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.487037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.487637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:56.489244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:56.500578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 12:45:56.501708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 491/982] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:45:56 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:56.508085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:56.517551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404fd58-e014-42ce-8177-3dd9f849a31c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:56.522313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:56.523247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.523525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.523803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.524503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:56.524777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:56.526387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:56.531933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 492/983] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:56 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:56.538254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:56.549429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a2d5-fbb8-42dc-9d2d-8acb841d597a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:56.554713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:56.555303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.555583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.555859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.556565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:56.556860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:56.558488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:56.564050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 492/984] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:56 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:56.570274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:56.580558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d1a6-b128-462d-8338-3e4b5edb2e35 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:56.585002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:56.585573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.585854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.586128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.586864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] RBAC: Adding query filter params (interface=admin, service_id=c9202fc9f191444794874c41aee69cd2, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:56.587169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:56.588811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2e5f-f4a9-468d-bcae-330335ac1949 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:56.594762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 493/985] 10.222.0.60 () {56 vars in 1270 bytes} [Tue Nov 23 12:45:56 2021] GET /identity/v3/endpoints?service_id=c9202fc9f191444794874c41aee69cd2&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:56.600822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:56.610792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5601-e521-484b-ad18-4e88ebaa426e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:56.616092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:56.616772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:56.617046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:56.617320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:56.617997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:56.619663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc7bd9-5883-49d4-8df1-1b52fde41b6a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:56.627060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 493/986] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:45:56 2021] GET /identity/v3/services => generated 2196 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:45:58.717743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86202a-8aa2-4d58-a321-57d08815fda5 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.718304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86202a-8aa2-4d58-a321-57d08815fda5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.718304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86202a-8aa2-4d58-a321-57d08815fda5 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.720004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 494/987] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:45:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:45:58.725578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.726029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.726135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.756229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:45:58.757544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:45:58.767553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 494/988] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:45:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:45:58.791235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86202a-8aa2-4d58-a321-57d08815fda5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:58.805568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86202a-8aa2-4d58-a321-57d08815fda5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:58.810541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:58.811280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.811549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.811840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.812490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:58.814087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:58.825191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 12:45:58.826313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 495/989] 10.222.0.60 () {56 vars in 1147 bytes} [Tue Nov 23 12:45:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:45:58.833463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:58.846984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e53e91-ea5c-49ef-b45e-42c69febd79f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:58.851207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:58.851799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.852084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.852402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.853114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:58.853408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:58.855001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:58.860146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 495/990] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:58.866343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:58.876800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c2f86-f83c-4d11-b06a-4cad81667338 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:58.881417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:58.882051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.882342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.882611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.883331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:45:58.883615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:58.885286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82bb9b-f6d0-41ff-a3c0-bd78c8f6260e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:58.890991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 496/991] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Nov 23 12:45:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:45:58.897239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:45:58.907652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b30f4-3c51-4c0c-822e-81cc1fc9ec3d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:45:58.912554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:45:58.913122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:45:58.913401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:45:58.913672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:45:58.914364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:45:58.915937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea25b8-af21-4cbb-98bf-cda3d08e4004 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:45:58.933010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 496/992] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:45:58 2021] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:01.057839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c656-401c-4ed6-a5f2-675e43dc6854 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:01.058472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c656-401c-4ed6-a5f2-675e43dc6854 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:01.058472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c656-401c-4ed6-a5f2-675e43dc6854 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:01.060536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 497/993] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:01.066400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:01.067030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:01.067225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:01.091759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:01.093004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:01.120341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 497/994] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:01.145089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c656-401c-4ed6-a5f2-675e43dc6854 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:01.159761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c656-401c-4ed6-a5f2-675e43dc6854 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:01.165042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:01.165780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:01.166065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:01.166346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:01.167531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:01.169332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9e378-2b1a-4255-a986-554079817cac admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:01.170830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 498/995] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:46:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:01.177163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:01.186928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3fdf1-587e-46e5-a1b5-9668a7223069 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:01.192590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:01.193193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:01.193474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:01.193748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:01.194402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:01.196354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efcd9-5110-4f43-bd75-5466e657b1c2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:01.227255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 498/996] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:46:01 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:03.366263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a805e3-1cb5-4ad1-a95a-698fcf959f67 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:03.366883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a805e3-1cb5-4ad1-a95a-698fcf959f67 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:03.366883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a805e3-1cb5-4ad1-a95a-698fcf959f67 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:03.368505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 499/997] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:03.374331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:03.374851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:03.374992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:03.399112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:03.399895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:03.493670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 499/998] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:03.537098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a805e3-1cb5-4ad1-a95a-698fcf959f67 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:03.558221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a805e3-1cb5-4ad1-a95a-698fcf959f67 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:03.565799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:03.566973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:03.567459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:03.567951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:03.569861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:03.572930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15d6d3-a739-4bea-893e-407f7ff6da75 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:03.575854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 500/999] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:46:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:03.585318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:03.594954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9227-d5cd-4c3c-981d-98bae30728f2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:03.600571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:03.601203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:03.601487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:03.601764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:03.602461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:03.604477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f252-8e7f-48d8-910c-6e8eeff3ec64 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:03.629369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 500/1000] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:46:03 2021] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:05.815856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3d35a-3bea-4d9e-8114-5b6336997dfa None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:05.816577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3d35a-3bea-4d9e-8114-5b6336997dfa None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:05.816938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3d35a-3bea-4d9e-8114-5b6336997dfa None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:05.820168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 501/1001] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:05.827366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:05.828148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:05.828148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:05.852100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:05.853321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:05.861912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:05 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:46:05.886298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3d35a-3bea-4d9e-8114-5b6336997dfa None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:05.899263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3d35a-3bea-4d9e-8114-5b6336997dfa None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:05.903559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:05.904296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:05.904565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:05.904844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:05.917142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:05.923645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:05.924828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 502/1003] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:05.931414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:05.941033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43ed5-d763-4f4b-a481-b59d6c4e9d80 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:05.946154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:05.946775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:05.947059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:05.947333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:05.948067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:05.948415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:05.950417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:05.960150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 502/1004] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:05.967114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:05.977279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53868-4302-4db9-afb2-8b552cfcd200 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:05.982667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:05.983495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:05.983774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:05.984049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] PATH_INFO: `/v3/users/6f94bb759db9468890c62cebbf2f42ec` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:06.006892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] RBAC: Authorizing `identity:get_user(user_id=6f94bb759db9468890c62cebbf2f42ec)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:06.009085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:06.010719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 503/1005] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:05 2021] GET /identity/v3/users/6f94bb759db9468890c62cebbf2f42ec => generated 285 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:46:06.017741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:06.033330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13204d-5366-4424-9d1f-a3c2395f2669 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:06.038775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:06.039363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:06.039646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:06.039920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:06.049858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:06.051691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:06.061189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 503/1006] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:06 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:06.067746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:06.078094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6e29-e3ff-409f-a00e-d60920077a4c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:06.082660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:06.083473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:06.083756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:06.084029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:06.085210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:06.087274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294da83-9e1c-4f23-bf80-e1cc0fb0aa44 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:06.088863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 504/1007] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:06 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:06.095584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:06.105120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e50ed-fc93-4394-a69a-ac5cae735409 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:06.110704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:06.111294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:06.111575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:06.111911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:06.112757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=bfacf529bd0e454891b501b5d20c5acc, user.id=6f94bb759db9468890c62cebbf2f42ec) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:06.113053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:06.114986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d950-f7cc-4c43-8cc5-cf8035832f0c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:06.121538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 504/1008] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:06 2021] GET /identity/v3/role_assignments?user.id=6f94bb759db9468890c62cebbf2f42ec&scope.project.id=bfacf529bd0e454891b501b5d20c5acc&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:08.234059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b7de-48f2-453b-b97f-390da99d69c7 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.234629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b7de-48f2-453b-b97f-390da99d69c7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.234629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b7de-48f2-453b-b97f-390da99d69c7 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.236269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 505/1009] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:08.243259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.243872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.243872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.269724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:08.270982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:08.280573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 505/1010] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:08.304405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948b7de-48f2-453b-b97f-390da99d69c7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:08.319007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948b7de-48f2-453b-b97f-390da99d69c7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:08.323986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:08.324923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.325206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.325732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.339078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:08.346086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:08.347312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 506/1011] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:08.354232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:08.368016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d3e5-71dc-4e68-8838-b204d42f782b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:08.376886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:08.377894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.378391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.378883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.380163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:08.380713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:08.383756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:08.400588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 506/1012] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:08.407517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:08.419012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352531f-b2d7-4826-879d-befc417fd01d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:08.424148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:08.425097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.425432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.425754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] PATH_INFO: `/v3/users/6f94bb759db9468890c62cebbf2f42ec` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.427107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] RBAC: Authorizing `identity:get_user(user_id=6f94bb759db9468890c62cebbf2f42ec)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:08.429334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:08.430953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 507/1013] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:08 2021] GET /identity/v3/users/6f94bb759db9468890c62cebbf2f42ec => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:08.437843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:08.448070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378545a-fed1-4da5-b1f4-aa7b730b6fc5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:08.453560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:08.454359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.454640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.454912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.456196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:08.458293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efd1b4-8e0b-4461-8c00-eaa73a874808 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:08.459973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 507/1014] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:08 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:08.470145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:08.480667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e34d95-c1e4-4f4b-838d-849f7befd8fb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:08.486466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:08.487265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:08.487577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:08.487890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc/users/6f94bb759db9468890c62cebbf2f42ec/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:08.490057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfacf529bd0e454891b501b5d20c5acc, user_id=6f94bb759db9468890c62cebbf2f42ec, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:08.492858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0bc3-cfec-46d3-aa3e-8b4451111cc9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:08.508795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 508/1015] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:46:08 2021] PUT /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc/users/6f94bb759db9468890c62cebbf2f42ec/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:46:10.700287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecec8-c57c-4eac-b4df-55a3863a0d2c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.700889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecec8-c57c-4eac-b4df-55a3863a0d2c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.700889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eecec8-c57c-4eac-b4df-55a3863a0d2c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:10.702522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 508/1016] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:46:10.708873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.709691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.709691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:10.733863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:10.735125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:10.814313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 509/1017] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:10.839364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eecec8-c57c-4eac-b4df-55a3863a0d2c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:10.853347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eecec8-c57c-4eac-b4df-55a3863a0d2c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:10.858275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:10.859042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.859327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.859638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:10.873590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:10.879926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:10.881137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 509/1018] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:46:10.888421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:10.898658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68e25a-3c58-4a8e-bc91-de7f4e9cfc6d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:10.904038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:10.904704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.904994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.905278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:10.906013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:10.906313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:10.907990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:10.918298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 510/1019] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:10.928640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:10.946322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e23bf-c306-4ee8-bfc6-01001e6ad0ff admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:10.955208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:10.956544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.957039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.957541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] PATH_INFO: `/v3/users/6f94bb759db9468890c62cebbf2f42ec` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:10.959560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] RBAC: Authorizing `identity:get_user(user_id=6f94bb759db9468890c62cebbf2f42ec)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:10.963804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:10.967255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 510/1020] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:10 2021] GET /identity/v3/users/6f94bb759db9468890c62cebbf2f42ec => generated 285 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:10.973696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:10.984178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661471-e090-4793-82eb-bac971442f72 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:10.990056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:10.990653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:10.990933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:10.991209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:11.001389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:11.003356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:11.014013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 511/1021] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:10 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:11.021738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:11.039716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c01f25-7fc2-4e70-b94d-0428a5c7b53f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:11.048185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:11.049584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:11.050098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:11.050612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:11.052699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:11.056766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ef2c0-f847-4618-973d-4fb9d9125aaf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:11.060004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 511/1022] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:11 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:11.066917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:11.076727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0c88-1489-428b-8d21-7f2aeaeea27a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:11.083026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:11.083788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:11.084081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:11.084375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:11.085216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=bfacf529bd0e454891b501b5d20c5acc, user.id=6f94bb759db9468890c62cebbf2f42ec) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:11.085524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:11.087620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf614a-6cfb-4141-b83d-c776ef10ac97 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:11.095238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 512/1023] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:11 2021] GET /identity/v3/role_assignments?user.id=6f94bb759db9468890c62cebbf2f42ec&scope.project.id=bfacf529bd0e454891b501b5d20c5acc&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:13.917610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8fc9-fb66-4956-a9b8-bccb7c99bd4b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:13.918256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8fc9-fb66-4956-a9b8-bccb7c99bd4b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:13.918529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8fc9-fb66-4956-a9b8-bccb7c99bd4b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:13.921723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 512/1024] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:13.931053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:13.931877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:13.931877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:13.956267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:13.957466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:13.966076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 513/1025] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:13.996084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8fc9-fb66-4956-a9b8-bccb7c99bd4b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:14.013370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8fc9-fb66-4956-a9b8-bccb7c99bd4b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:14.018217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:14.018990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:14.019363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:14.019676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:14.021039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:14.023341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5f7b-e643-4194-a4c3-e749b0bd2c58 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:14.025138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 513/1026] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:46:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:14.033158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:14.050581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7ca8-5e19-4947-a617-4f1bf614f7c3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:14.058919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:14.059990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:14.060532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:14.061034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:14.062278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:14.066383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751aa4-8d1d-4133-89e3-75bb66c75b36 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:14.097309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 514/1027] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:46:14 2021] POST /identity/v3/users => generated 286 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:16.432564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3f23-da4b-43ba-90ee-eabb3e2dacfb None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.433266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3f23-da4b-43ba-90ee-eabb3e2dacfb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.433266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f3f23-da4b-43ba-90ee-eabb3e2dacfb None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.435243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 514/1028] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:16.441570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.442255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.442255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.466462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:16.467633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:16.476329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:16.500545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f3f23-da4b-43ba-90ee-eabb3e2dacfb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:16.514323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f3f23-da4b-43ba-90ee-eabb3e2dacfb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:16.518739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:16.519546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.519826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.520109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] PATH_INFO: `/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.521506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] RBAC: Authorizing `identity:get_role(role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:16.522887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:46:16.522887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:46:16.522887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:46:16.523766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:16.525167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 515/1030] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:16 2021] GET /identity/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:16.531839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:16.542193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2085497-9ee6-4652-96e6-d19e25062994 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:16.547709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:16.548621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.548905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.549184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] PATH_INFO: `/v3/users/b26bcd3e692e4009a33664fe5573fc1f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.570588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b26bcd3e692e4009a33664fe5573fc1f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:16.572867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:16.574619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 516/1031] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:16 2021] GET /identity/v3/users/b26bcd3e692e4009a33664fe5573fc1f => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:16.581210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:16.591514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266e0b-6f1e-45e5-97fa-06d43f8abccf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:16.596229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:16.596845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.597127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.597403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.606619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:16.608413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:16.618010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 516/1032] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:16 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:16.624819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:16.635450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6250-a36b-476e-b452-baee11d0bcd1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:16.640577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:16.641406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.641697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.641976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.643155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:16.645276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b9e29-8eb5-48dc-a0d0-e8637c271bb9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:16.647248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 517/1033] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:16 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:16.653980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:16.663362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadb46-8690-48ab-a510-b8242949d9f8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:16.669253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:16.669844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:16.670122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:16.670396 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:16.671177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=bfacf529bd0e454891b501b5d20c5acc, user.id=b26bcd3e692e4009a33664fe5573fc1f) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:16.671476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:16.673364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef9f1-83b0-4aa0-b097-928cc074dccf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:16.680665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 517/1034] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:16 2021] GET /identity/v3/role_assignments?user.id=b26bcd3e692e4009a33664fe5573fc1f&scope.project.id=bfacf529bd0e454891b501b5d20c5acc&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:18.848928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f675-1e3e-4587-8267-36d5ff69355b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:18.849562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f675-1e3e-4587-8267-36d5ff69355b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:18.849562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f675-1e3e-4587-8267-36d5ff69355b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:18.851232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 518/1035] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:46:18.857617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:18.858187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:18.858187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:18.881843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:18.883023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:18.890915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 518/1036] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:18.914487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f675-1e3e-4587-8267-36d5ff69355b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:18.928842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f675-1e3e-4587-8267-36d5ff69355b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:18.934364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:18.935204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:18.935491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:18.935773 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] PATH_INFO: `/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:18.937240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] RBAC: Authorizing `identity:get_role(role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:18.938311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:46:18.938311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:46:18.938311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:46:18.939278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:18.940742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:18 2021] GET /identity/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:18.947141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:18.957484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab499eff-9533-4749-91b2-c11a99126632 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:18.962350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:18.963182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:18.963474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:18.963767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] PATH_INFO: `/v3/users/b26bcd3e692e4009a33664fe5573fc1f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:18.965052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=b26bcd3e692e4009a33664fe5573fc1f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:18.967422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:18.969187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 519/1038] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:18 2021] GET /identity/v3/users/b26bcd3e692e4009a33664fe5573fc1f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:18.979676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:18.998292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f4311-ee5c-421b-ba83-a826cca86a0c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:19.006556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:19.007920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:19.008439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:19.008931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:19.011009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:19.015168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db96e-66cc-40d1-991c-15d2f86e503f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:19.018179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:18 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:46:19.028420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:19.040399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc902-8f30-45a8-b93d-2d4f2bf3cfd4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:19.046480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:19.047398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:19.047683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:19.047962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc/users/b26bcd3e692e4009a33664fe5573fc1f/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:19.050500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfacf529bd0e454891b501b5d20c5acc, user_id=b26bcd3e692e4009a33664fe5573fc1f, role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:19.053243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0cdaf-d8fe-4ab7-b808-268064e1f80c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:19.069727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:46:19 2021] PUT /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc/users/b26bcd3e692e4009a33664fe5573fc1f/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:46:21.249714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f64d-fcac-4a84-9824-72b83cf71c09 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.250351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f64d-fcac-4a84-9824-72b83cf71c09 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.250351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2f64d-fcac-4a84-9824-72b83cf71c09 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.251938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 521/1041] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:21.258248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.258876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.258876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.284547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:21.285753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:21.358217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 521/1042] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:21.382477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2f64d-fcac-4a84-9824-72b83cf71c09 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:21.397391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2f64d-fcac-4a84-9824-72b83cf71c09 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:21.402325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:21.403176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.403457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.403742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] PATH_INFO: `/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.405346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] RBAC: Authorizing `identity:get_role(role_id=f906b8c9aa0b4cec9caa19b278c2ea90)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:21.407077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:21.408599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 522/1043] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:21 2021] GET /identity/v3/roles/f906b8c9aa0b4cec9caa19b278c2ea90 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:21.415387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:21.425642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847994f-7e22-470c-be21-5e530fe0f4ae None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:21.430960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:21.431796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.432078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.432400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] PATH_INFO: `/v3/users/b26bcd3e692e4009a33664fe5573fc1f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.433722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] RBAC: Authorizing `identity:get_user(user_id=b26bcd3e692e4009a33664fe5573fc1f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:21.435950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:21.437805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 522/1044] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:21 2021] GET /identity/v3/users/b26bcd3e692e4009a33664fe5573fc1f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:21.449526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:21.467816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79b61-9b11-4a4d-ba75-31a9ea76f6de admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:21.476503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:21.477514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.478003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.478496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.497494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:21.500884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:21.519374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 523/1045] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:21 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:21.529131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:21.540090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367155-ff38-4bb4-9d11-5dec01e1244f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:21.547645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:21.548578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.548905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.549230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.550711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:21.553252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af45a4-dd62-4fd2-9f95-66b910ee61bd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:21.555292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 523/1046] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:21 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:21.563158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:21.580144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62df3d-b3bf-4fb3-9f94-ad90b62e62cf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:21.587364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:21.587992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:21.588271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:21.588603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:21.589457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] RBAC: Adding query filter params (role.id=f906b8c9aa0b4cec9caa19b278c2ea90, scope.project.id=bfacf529bd0e454891b501b5d20c5acc, user.id=b26bcd3e692e4009a33664fe5573fc1f) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:21.589764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:21.591726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e486-2479-4cae-925c-2d47c72b7b2f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:21.598947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 524/1047] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:21 2021] GET /identity/v3/role_assignments?user.id=b26bcd3e692e4009a33664fe5573fc1f&scope.project.id=bfacf529bd0e454891b501b5d20c5acc&role.id=f906b8c9aa0b4cec9caa19b278c2ea90 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:23.869900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95351-8c11-465b-ab50-0c615a1c84ce None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:23.870591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95351-8c11-465b-ab50-0c615a1c84ce None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:23.870591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95351-8c11-465b-ab50-0c615a1c84ce None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:23.872658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 524/1048] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:23.879149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:23.879740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:23.879740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:23.906045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:23.907281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:23.915925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 525/1049] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:23 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:23.941072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95351-8c11-465b-ab50-0c615a1c84ce None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:23.955014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95351-8c11-465b-ab50-0c615a1c84ce None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:23.959841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:23.960735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:23.961038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:23.961321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:23.962634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:23.964508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfb840-fdfd-4fc6-9e54-d1f5d7c09004 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:23.966163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 525/1050] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:46:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:23.973558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:23.989750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fc9d-ee87-47ef-a6ea-4398b48db904 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:23.997208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:23.998232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:23.998710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:23.999179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:24.000474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:24.004055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02f35-0745-4ba4-b37c-800231b2ea96 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:24.052807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 526/1051] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:46:23 2021] POST /identity/v3/projects => generated 311 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:26.351434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038427a-ca05-4969-b368-0078a9f1b721 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:26.352098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038427a-ca05-4969-b368-0078a9f1b721 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:26.352098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038427a-ca05-4969-b368-0078a9f1b721 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:26.353892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 526/1052] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:26.360609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:26.361468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:26.361665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:26.386839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:26.388383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:26.470085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 527/1053] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:26.495446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038427a-ca05-4969-b368-0078a9f1b721 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:26.508903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038427a-ca05-4969-b368-0078a9f1b721 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:26.514073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:26.514802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:26.515079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:26.515351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:26.516611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:26.518500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0949d-3dc3-4401-85f7-cb6578f60a20 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:26.520264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 527/1054] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:46:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:46:26.527532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:26.537284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea25dc-a04a-4bca-944d-ea9d700a1042 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:26.542592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:26.543275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:26.543598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:26.543915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:26.544704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:26.546762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48744809-2b0e-4a2e-9d4d-9bd6e0ce889e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:26.571325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 528/1055] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:46:26 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:28.865416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ec94-252f-48f0-98b2-abef9e63f2a9 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:28.865989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ec94-252f-48f0-98b2-abef9e63f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:28.865989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ec94-252f-48f0-98b2-abef9e63f2a9 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:28.867876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 528/1056] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:28.874561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:28.875301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:28.875522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:28.917922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:28.919837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:28.933192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 529/1057] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:28.957864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ec94-252f-48f0-98b2-abef9e63f2a9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:28.972772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ec94-252f-48f0-98b2-abef9e63f2a9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:28.978345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:28.979120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:28.979404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:28.979686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:28.993782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:29.000574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:29.001887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 529/1058] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:29.008759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:29.022183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401744e-3fb2-4774-8e7a-5a1f0cdb4a54 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:29.027001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:29.027688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:29.027970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:29.028257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:29.029019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:29.029319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:29.030980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:29.040979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 530/1059] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:29.051547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:29.067998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da76b7-92ad-4571-91bb-98a808b2886a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:29.075011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:29.075952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:29.076387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:29.076749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] PATH_INFO: `/v3/users/df96507db6294aaf8a383f26375ab060` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:29.099021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] RBAC: Authorizing `identity:get_user(user_id=df96507db6294aaf8a383f26375ab060)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:29.101433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:29.103290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 530/1060] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:29 2021] GET /identity/v3/users/df96507db6294aaf8a383f26375ab060 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:29.110592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:29.122252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2580-0172-4168-9648-e230c656db42 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:29.128016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:29.128667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:29.128956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:29.129232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:29.139710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:29.141630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:29.153181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 531/1061] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:29 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:29.160110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:29.171066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb2368-b61d-4c3c-b9e9-796def39c3ad admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:29.176404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:29.177233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:29.177521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:29.177788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] PATH_INFO: `/v3/projects/324369dc1750429882979e844308778e` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:29.179011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] RBAC: Authorizing `identity:get_project(project_id=324369dc1750429882979e844308778e)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:29.181268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71002-6e2e-48f7-8efa-157b337f4dde admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:29.183233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 531/1062] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:29 2021] GET /identity/v3/projects/324369dc1750429882979e844308778e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:29.190227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:29.200453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74bf14-0aca-4435-9380-dc83c43511aa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:29.205614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:29.206229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:29.206525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:29.206806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:29.207651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=324369dc1750429882979e844308778e, user.id=df96507db6294aaf8a383f26375ab060) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:29.207954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:29.209938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4613-0ac9-4d47-9879-ac4d673c03f7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:29.216853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 532/1063] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:29 2021] GET /identity/v3/role_assignments?user.id=df96507db6294aaf8a383f26375ab060&scope.project.id=324369dc1750429882979e844308778e&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:31.803871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487676-05c3-4c06-82b0-b7ad148b6db5 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:31.804857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487676-05c3-4c06-82b0-b7ad148b6db5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:31.804857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80487676-05c3-4c06-82b0-b7ad148b6db5 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:31.806453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 532/1064] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:46:31.815884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:31.816830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:31.817043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:31.848388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:31.849940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:31.858786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 533/1065] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:31.882272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80487676-05c3-4c06-82b0-b7ad148b6db5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:31.895899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80487676-05c3-4c06-82b0-b7ad148b6db5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:31.901416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:31.902427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:31.902717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:31.903031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:31.917554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:31.924275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:31.925629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 533/1066] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:31.932754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:31.942739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd65e0-d213-4d34-bc22-2de026fe156e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:31.948382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:31.949836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:31.950124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:31.950396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:31.951190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:31.951493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:31.953269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:31.963731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 534/1067] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:31.970909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:31.982506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c202fa-bd5c-4236-871c-202c631ded22 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:31.988530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:31.989339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:31.989617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:31.989892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] PATH_INFO: `/v3/users/df96507db6294aaf8a383f26375ab060` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:31.991171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] RBAC: Authorizing `identity:get_user(user_id=df96507db6294aaf8a383f26375ab060)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:31.993356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:31.994941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 534/1068] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:31 2021] GET /identity/v3/users/df96507db6294aaf8a383f26375ab060 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:32.002353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:32.022190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43aec3-7bca-49bd-a653-8a71c243d1b4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:32.029912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:32.031329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:32.031846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:32.032407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] PATH_INFO: `/v3/projects/324369dc1750429882979e844308778e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:32.034415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=324369dc1750429882979e844308778e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:32.038690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a169f-059f-4044-a998-7b8be6c801b6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:32.041923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 535/1069] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:32 2021] GET /identity/v3/projects/324369dc1750429882979e844308778e => generated 311 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:32.048971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:32.060767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1355-19b9-4532-8a74-1e3a0f525831 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:32.066791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:32.067681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:32.068007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:32.068383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] PATH_INFO: `/v3/projects/324369dc1750429882979e844308778e/users/df96507db6294aaf8a383f26375ab060/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:32.070662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] RBAC: Authorizing `identity:create_grant(project_id=324369dc1750429882979e844308778e, user_id=df96507db6294aaf8a383f26375ab060, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:32.073539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ba2c6-9b54-42b6-8195-af3f75f514db admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:32.090060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 535/1070] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:46:32 2021] PUT /identity/v3/projects/324369dc1750429882979e844308778e/users/df96507db6294aaf8a383f26375ab060/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:46:34.318238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac4d-7906-4cf9-9de3-0d1e31317b4d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.318854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac4d-7906-4cf9-9de3-0d1e31317b4d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.318854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac4d-7906-4cf9-9de3-0d1e31317b4d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.320566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 536/1071] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:34.328327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.329168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.329319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.355466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:34.356691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:34.431275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 536/1072] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:34.455640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ac4d-7906-4cf9-9de3-0d1e31317b4d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.470710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ac4d-7906-4cf9-9de3-0d1e31317b4d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.476452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.477473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.477779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.478060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.492660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:34.499884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:34.501157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 537/1073] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:34.508129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.518095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41daa-3daa-4d4a-a9de-0955315789dd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.524382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.525005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.525290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.525569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.526660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:34.527033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:34.528826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:34.539369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 537/1074] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:46:34.546511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.557213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86b5f-b640-442f-b72c-fb46a0ee26c0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.562906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.563742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.564022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.564356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] PATH_INFO: `/v3/users/df96507db6294aaf8a383f26375ab060` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.565708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=df96507db6294aaf8a383f26375ab060)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:34.567928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:34.569768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 538/1075] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/users/df96507db6294aaf8a383f26375ab060 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:34.576537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.588608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5f28-fe80-4adf-b8ab-700aae98d7af admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.593877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.594472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.594761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.595042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.605135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:34.607492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:34.617743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 538/1076] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:34.627653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.644466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3af9c-0cbf-48d0-aab0-5f3c3435d8a1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.652820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.654189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.654656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.655135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] PATH_INFO: `/v3/projects/324369dc1750429882979e844308778e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.657167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] RBAC: Authorizing `identity:get_project(project_id=324369dc1750429882979e844308778e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:34.661056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0643c-6521-40ad-ac42-6b003333430c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:34.663985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 539/1077] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/projects/324369dc1750429882979e844308778e => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:34.674421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:34.684730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de619c3-db28-40af-bb40-5f157ec560e6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:34.690392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:34.691006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:34.691294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:34.691578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:34.692489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=324369dc1750429882979e844308778e, user.id=df96507db6294aaf8a383f26375ab060) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:34.692803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:34.694733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a9fa-12fd-4777-baf3-40b0dc62224e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:34.702432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 539/1078] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:34 2021] GET /identity/v3/role_assignments?user.id=df96507db6294aaf8a383f26375ab060&scope.project.id=324369dc1750429882979e844308778e&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:46:37.013926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768239e-d10e-4da7-b6af-513c8daae8a6 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:37.014496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768239e-d10e-4da7-b6af-513c8daae8a6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:37.014496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768239e-d10e-4da7-b6af-513c8daae8a6 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:37.016171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 540/1079] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:37.022841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:37.023420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:37.023420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:37.049248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:37.050449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:37.058721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 540/1080] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:37.083003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768239e-d10e-4da7-b6af-513c8daae8a6 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:37.098355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768239e-d10e-4da7-b6af-513c8daae8a6 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:37.103309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:37.104040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:37.104548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:37.104928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:37.114759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:37.116753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:37.127531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 541/1081] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:37.134943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:37.151707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618299b4-7cff-405d-89dd-ca7b71dca386 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:37.159497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:37.160834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:37.161320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:37.161823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:37.177294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:37.180963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:37.209296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-e8a507f0-f885-4f51-90ed-1128ef886d27 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 23 12:46:37.211500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 541/1082] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:46:37 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:37.218545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:37.228539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdab3a-153e-42e4-af6a-7963d55d75d9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:37.234727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:37.235344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:37.235624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:37.235897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:37.236680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:37.236983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:37.238666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895574f0-17e8-4d7a-a87f-35e797d35510 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:37.248528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 542/1083] 10.222.0.60 () {56 vars in 1136 bytes} [Tue Nov 23 12:46:37 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:39.452607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181df04-8f50-47ac-99ce-ab3827e97ced None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:39.453258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181df04-8f50-47ac-99ce-ab3827e97ced None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:39.453258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181df04-8f50-47ac-99ce-ab3827e97ced None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:39.455060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 542/1084] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:39.461383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda044ec-992a-456a-9b21-072d03eb4fad None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:39.461954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda044ec-992a-456a-9b21-072d03eb4fad None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:39.461954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda044ec-992a-456a-9b21-072d03eb4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:39.487754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fda044ec-992a-456a-9b21-072d03eb4fad None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:39.489108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fda044ec-992a-456a-9b21-072d03eb4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:39.497436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 543/1085] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:39 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:39.522337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181df04-8f50-47ac-99ce-ab3827e97ced None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:39.536404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181df04-8f50-47ac-99ce-ab3827e97ced None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:39.541170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:39.541789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:39.542076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:39.542345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:39.543148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:39.544127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:46:39.544127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:46:39.544127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:46:39.545050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aae09-5713-4719-8504-e6db9f82f8be admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:39.563684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 543/1086] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Nov 23 12:46:39 2021] POST /identity/v3/domains => generated 267 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 12:46:41.773484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf716f-0e06-4e05-b122-47e91a67a1be None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:41.774094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf716f-0e06-4e05-b122-47e91a67a1be None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:41.774094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf716f-0e06-4e05-b122-47e91a67a1be None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:41.775989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 544/1087] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:41.783879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:41.784588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:41.784588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:41.812958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:41.814108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:41.887797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 544/1088] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:41.913085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf716f-0e06-4e05-b122-47e91a67a1be None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:41.926929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf716f-0e06-4e05-b122-47e91a67a1be None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:41.931743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:41.933016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:41.933300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:41.933574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] PATH_INFO: `/v3/domains/f89b0ba5f654454d982a38d67477e15d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:41.947712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f89b0ba5f654454d982a38d67477e15d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:41.949782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc447917-281f-47b9-8ed9-8b3d5dc7aaa4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:41.951456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 545/1089] 10.222.0.60 () {56 vars in 1204 bytes} [Tue Nov 23 12:46:41 2021] GET /identity/v3/domains/f89b0ba5f654454d982a38d67477e15d => generated 267 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:41.958033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:41.967467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc2a6-191d-4a55-abaa-ea6de6392bdf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:41.972673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:41.973333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:41.973656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:41.973970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:41.974670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:41.976720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2fab-9049-44f1-bd0d-b21c6d42856f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:42.007814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 545/1090] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:46:41 2021] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:44.216502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ec8c-c8ad-4853-a1cb-3c71ff28fc7a None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:44.217044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ec8c-c8ad-4853-a1cb-3c71ff28fc7a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:44.217044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ec8c-c8ad-4853-a1cb-3c71ff28fc7a None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:44.218674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 546/1091] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:44.224545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:44.225068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:44.225156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:44.248760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:44.249938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:44.322104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 546/1092] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:44 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:44.347920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ec8c-c8ad-4853-a1cb-3c71ff28fc7a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:44.362392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ec8c-c8ad-4853-a1cb-3c71ff28fc7a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:44.367346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:44.368157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:44.368469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:44.368745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] PATH_INFO: `/v3/domains/f89b0ba5f654454d982a38d67477e15d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:44.369991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f89b0ba5f654454d982a38d67477e15d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:44.372014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650bd52-28d5-46bf-bb32-061b8a5df828 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:44.373642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 547/1093] 10.222.0.60 () {56 vars in 1204 bytes} [Tue Nov 23 12:46:44 2021] GET /identity/v3/domains/f89b0ba5f654454d982a38d67477e15d => generated 267 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:44.380004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:44.389471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f779e-9907-4930-997c-a132d5420580 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:44.394443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:44.395103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:44.395439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:44.395755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:44.396822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:44.398853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa4f65-5254-4bde-b2e7-eda12d8f5764 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:44.421903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 547/1094] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:46:44 2021] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:46:46.651203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ec63d-291f-406f-bdbf-70429093f937 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.651980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ec63d-291f-406f-bdbf-70429093f937 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.652127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ec63d-291f-406f-bdbf-70429093f937 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.654166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 548/1095] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:46.661412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.662002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.662401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.706411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:46.708791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:46.722438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 548/1096] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:46.749648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ec63d-291f-406f-bdbf-70429093f937 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:46.765152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ec63d-291f-406f-bdbf-70429093f937 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:46.770622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:46.771766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.772079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.772453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.787165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:46.794823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:46.796055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 549/1097] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:46.803804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:46.820684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5fa2-5e71-4693-a6d5-3dccb2ac1565 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:46.828162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:46.829307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.829819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.830315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.831661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:46.832200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:46.835380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:46.857752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 549/1098] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:46.859212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:46.870834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b04b-2890-4069-9f63-59071fbc76d6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:46.875975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:46.876847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.877128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.877404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] PATH_INFO: `/v3/users/3aad461a597344d2bf750cedb0d7d90b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.899060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] RBAC: Authorizing `identity:get_user(user_id=3aad461a597344d2bf750cedb0d7d90b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:46.902117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:46.903747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 550/1099] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/users/3aad461a597344d2bf750cedb0d7d90b => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:46.910078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:46.920913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573093fb-36fd-4094-9758-06a2e3dc0c25 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:46.926455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:46.927039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.927321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.927593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.937003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:46.938834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:46.949003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 550/1100] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:46:46.955679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:46.966353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34450175-f2ed-49e5-92f6-82eab3227eaf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:46.971213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:46.972042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:46.972402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:46.972740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] PATH_INFO: `/v3/projects/965aa47964184ec5b055bf508a421f8b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:46.973996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] RBAC: Authorizing `identity:get_project(project_id=965aa47964184ec5b055bf508a421f8b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:46.976150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052871f8-eba6-4e13-83c9-28ea71cd4d4d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:46.977892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 551/1101] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/projects/965aa47964184ec5b055bf508a421f8b => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:46.985309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:47.001879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221916d-e124-4ef0-b3a7-5fe6ba725cdb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:47.009413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:47.010409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:47.010940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:47.011442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:47.013017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=965aa47964184ec5b055bf508a421f8b, user.id=3aad461a597344d2bf750cedb0d7d90b) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:47.013575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:47.017325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c147b23-2a1a-44f8-a91e-cd5b8d2f7448 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:47.028531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 551/1102] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:46 2021] GET /identity/v3/role_assignments?user.id=3aad461a597344d2bf750cedb0d7d90b&scope.project.id=965aa47964184ec5b055bf508a421f8b&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:49.187820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044cea5-1070-4781-8c7d-b08a13877d07 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.188453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044cea5-1070-4781-8c7d-b08a13877d07 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.188453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044cea5-1070-4781-8c7d-b08a13877d07 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.190182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 552/1103] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:49.196517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.197219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.197329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.223217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:49.224652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:49.233849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 552/1104] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:49 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:49.257250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044cea5-1070-4781-8c7d-b08a13877d07 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:49.271383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044cea5-1070-4781-8c7d-b08a13877d07 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:49.276445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:49.277320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.277661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.277979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.291233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:49.298050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:49.299435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 553/1105] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:46:49.310438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:49.326871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee713891-b619-4b2d-a0a6-d1b5d13993bf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:49.334796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:49.335816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.336334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.336833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.338115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:49.338772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:49.341219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:49.351285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 553/1106] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:49.358015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:49.369265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812641-4e55-42a5-b3cd-4a4d32135a1f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:49.374627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:49.375446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.375725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.375998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] PATH_INFO: `/v3/users/3aad461a597344d2bf750cedb0d7d90b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.377277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] RBAC: Authorizing `identity:get_user(user_id=3aad461a597344d2bf750cedb0d7d90b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:49.379469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:49.381185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 554/1107] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:49 2021] GET /identity/v3/users/3aad461a597344d2bf750cedb0d7d90b => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:49.387589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:49.398201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595ff2-80f6-48dc-b705-0a764ae27b02 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:49.403365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:49.404178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.404491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.404768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] PATH_INFO: `/v3/projects/965aa47964184ec5b055bf508a421f8b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.406008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] RBAC: Authorizing `identity:get_project(project_id=965aa47964184ec5b055bf508a421f8b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:49.408092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad735c-5854-4e07-9646-67c23f5dd13b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:49.409793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 554/1108] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:49 2021] GET /identity/v3/projects/965aa47964184ec5b055bf508a421f8b => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:49.416286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:49.426678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccd3cb-5cc3-4ba2-b8b5-48a520780469 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:49.432613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:49.433482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:49.433761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:49.434040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] PATH_INFO: `/v3/projects/965aa47964184ec5b055bf508a421f8b/users/3aad461a597344d2bf750cedb0d7d90b/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:49.436166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=965aa47964184ec5b055bf508a421f8b, user_id=3aad461a597344d2bf750cedb0d7d90b, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:49.438976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32020e26-88f3-4dd3-8da8-70f3bb3cd06c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:49.457042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 555/1109] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:46:49 2021] PUT /identity/v3/projects/965aa47964184ec5b055bf508a421f8b/users/3aad461a597344d2bf750cedb0d7d90b/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:46:51.741398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5fd28-59be-4c4b-a159-7244a98dc0b6 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:51.742019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5fd28-59be-4c4b-a159-7244a98dc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:51.742019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5fd28-59be-4c4b-a159-7244a98dc0b6 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:51.743929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 555/1110] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:46:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:46:51.750363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:51.751240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:51.751240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:51.776444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:46:51.777692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:46:51.855191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 556/1111] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:46:51 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:46:51.880542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5fd28-59be-4c4b-a159-7244a98dc0b6 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:51.894810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5fd28-59be-4c4b-a159-7244a98dc0b6 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:51.900013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:51.900842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:51.901741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:51.902051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:51.916262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:46:51.923446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:46:51.924828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 556/1112] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:46:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:46:51.936913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:51.947131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a3a34-096d-4801-8e4c-2ba19a635530 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:51.952069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:51.952724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:51.953012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:51.953290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:51.954044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:51.954342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:51.956012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:51.967272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 557/1113] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:46:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:51.977413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:51.995515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b09f-6d42-4de8-b59d-d0f29a2bff1b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:52.004013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:52.005458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:52.005934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:52.006409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] PATH_INFO: `/v3/users/3aad461a597344d2bf750cedb0d7d90b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:52.008484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] RBAC: Authorizing `identity:get_user(user_id=3aad461a597344d2bf750cedb0d7d90b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:52.013006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:52.015890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 557/1114] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:46:51 2021] GET /identity/v3/users/3aad461a597344d2bf750cedb0d7d90b => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:52.026576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:52.038765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06368-91ed-4a24-aac0-3a1251ab3a1d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:52.044878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:52.045509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:52.045796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:52.046072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:52.055804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:52.058252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:52.070740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 558/1115] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:46:52 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:46:52.077610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:52.088321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58ee2b-f074-4919-ab13-663a7dc37b6c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:52.093575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:52.094452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:52.094776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:52.095093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] PATH_INFO: `/v3/projects/965aa47964184ec5b055bf508a421f8b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:52.096405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] RBAC: Authorizing `identity:get_project(project_id=965aa47964184ec5b055bf508a421f8b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:52.098559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e156-8332-4b63-9763-a6639cffb462 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:52.100320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 558/1116] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:46:52 2021] GET /identity/v3/projects/965aa47964184ec5b055bf508a421f8b => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:46:52.107129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:46:52.116830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339ed97-32a1-4b3e-8ed7-c3557e1e0c6d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:46:52.122226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:46:52.122864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:46:52.123150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:46:52.123436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:46:52.124316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=965aa47964184ec5b055bf508a421f8b, user.id=3aad461a597344d2bf750cedb0d7d90b) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:46:52.124625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:46:52.126532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0ff1-9354-4ecc-a6cc-c96266c10ad1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:46:52.133845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 559/1117] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:46:52 2021] GET /identity/v3/role_assignments?user.id=3aad461a597344d2bf750cedb0d7d90b&scope.project.id=965aa47964184ec5b055bf508a421f8b&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:40.276299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ec04-f2f8-4693-83ba-0a422f658ecf None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:40.276947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ec04-f2f8-4693-83ba-0a422f658ecf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:40.276947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ec04-f2f8-4693-83ba-0a422f658ecf None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:40.278562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 559/1118] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:40.285474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:40.286122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:40.286122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:40.314597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:40.315792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:40.324938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 560/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:40.351141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528ec04-f2f8-4693-83ba-0a422f658ecf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:40.365616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528ec04-f2f8-4693-83ba-0a422f658ecf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:40.370893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:40.371621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:40.371902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:40.372178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:40.388294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:40.390231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:40.410177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:40.411388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 560/1120] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:40.421622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:40.432657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871d4a-2cb5-4595-b4f4-efe8849564af None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:40.437894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:40.438538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:40.438837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:40.439268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:40.440298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:40.440635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:40.442410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06311-bde6-4eb5-afdf-ac94436acb9a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:40.457606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 561/1121] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:40.463922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:40.474013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf184-32c5-4a3f-b577-063239e97774 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:40.478868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:40.479480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:40.479755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:40.480028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:40.480730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:40.482676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c8437-61c0-465a-ba72-26fd6336c735 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:40.506012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 561/1122] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Nov 23 12:48:40 2021] POST /identity/v3/users => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:48:43.210593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82541-3987-454e-a674-a8af645517a0 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.211203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82541-3987-454e-a674-a8af645517a0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.211203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82541-3987-454e-a674-a8af645517a0 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.212867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 562/1123] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:43.223452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.224728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.225332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.248921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:43.250101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:43.258029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 562/1124] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:43.286812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82541-3987-454e-a674-a8af645517a0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.300073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82541-3987-454e-a674-a8af645517a0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.305005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.305765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.306047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.306316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.327910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:43.335697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:48:43.336945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 563/1125] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:48:43.347592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.357692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d28b26-2829-4d49-bf7f-2c3da8894058 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.363181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.363913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.364276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.364614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.365417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.365771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.367506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.377609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 563/1126] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:43.384041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.396371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f14e77-76ef-4938-9f04-221618d38ba9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.402608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.403376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.403672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.403937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.417398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.419292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.438968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:43.440299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 564/1127] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:43.448998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.459823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01edb1e-a69a-45c9-ac4a-cecf9a44fa1c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.465421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.465943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.466254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.466587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.467345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.467656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.469432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.484907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 564/1128] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:43.491779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.504165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93799ca-03a3-4ef7-bc9b-7181ed780909 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.509117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.509889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.510167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.510440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.528027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.530173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.554872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:43.556039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 565/1129] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/users/placement => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:43.562601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.573113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821f15-4aff-44c2-8da0-4af4c2bc610c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.578720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.579875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.580294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.580724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.581824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.582250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.584319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.621575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 565/1130] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:43.628912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.639464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c543b2-33a5-45ae-8370-cb4c3c498f35 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.644359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.645302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.645586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.645864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.655066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.656931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.667648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 566/1131] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:48:43.674510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.686919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b3eb-ee4e-420c-b73b-f4630570841a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.692874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.693790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.694173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.694558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.714571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.718249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.746139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:43.748545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 566/1132] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:43.757424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.772854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1a44-01f0-43d9-b173-f1e9b8aacad8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.780359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.781409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.781971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.782737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.784754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.785233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.787470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.805935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 567/1133] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:43.812319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.823397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2dd5-7c05-45ea-80b2-8c89cde958f1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.828670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.829804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.830155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.830595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.841037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.843909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.859205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:43.860981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 567/1134] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:48:43.867815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.878255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30477-cadf-4f6a-9560-68b27a905500 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.884134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.884775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.885063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.885345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.886158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.888660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.888660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474326f-44e4-45a0-a45b-c6caf7c84ef9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.907243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 568/1135] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:43.915138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:43.932404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3863b9-bdcf-4b39-b5b7-239d8e33786b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:43.939707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:43.940854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:43.941354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:43.941852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:43.943335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=330a0223f48d4b03bc84c07e34ec62a1) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:43.943935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:43.947617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791366-6caa-4768-9aca-2dcc182c9bc0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:43.959005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 568/1136] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:48:43 2021] GET /identity/v3/role_assignments?user.id=330a0223f48d4b03bc84c07e34ec62a1&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:46.157962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271505-3a28-4a0b-9f4f-38fee6465309 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.158514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271505-3a28-4a0b-9f4f-38fee6465309 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.158514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271505-3a28-4a0b-9f4f-38fee6465309 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.160168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 569/1137] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:46.166595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.167172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.167172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.191732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:46.192963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:46.200902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 569/1138] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:48:46.225320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271505-3a28-4a0b-9f4f-38fee6465309 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.239145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271505-3a28-4a0b-9f4f-38fee6465309 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.244514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.245275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.245562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.245832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.260040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:46.266881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:48:46.268869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 570/1139] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:46.275907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.285959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf639ad-13d4-4670-a6ac-34f86ce29fdc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.291754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.292432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.292712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.292981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.293708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] RBAC: Adding query filter params (name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:46.293998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.295598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.306545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 570/1140] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:46.313212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.325295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcaa1-9695-427a-a6df-cb1ec0c463d2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.331312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.332057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.332374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.332652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.345704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.347619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.367819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:46.369061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 571/1141] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:46.376329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.387844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66076-6984-45ae-9621-738e8472aecd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.394229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.395239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.395523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.395795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.396570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:46.396862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.398504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.414222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 571/1142] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:46.425159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.442987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a220ec-091a-466e-af2e-8718dbe69cab admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.451029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.452448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.452824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.453337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.480768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.484600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.523295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:46.525524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 572/1143] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/users/placement => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:46.532636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.544557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06270dec-ca61-44c2-86a9-c926918a30f4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.550628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.551290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.551574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.551900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.552823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:46.553164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.555144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.588992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 572/1144] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:46.595580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.607115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f899-0dad-472a-a600-ef6be956526e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.612717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.613487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.613766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.614041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.628050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.630297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.650385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:46.651585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 573/1145] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:46.658367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.668965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273acdf-6a3c-4123-8872-f82e3f9bcefc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.673537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.674155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.674449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.674735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.675471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:46.675767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.677453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.694500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 573/1146] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:46.701682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.715818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c29d4-1002-499e-90aa-20d6bf294abf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.723507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.724770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.725061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.725525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.737007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.739170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.754478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:46.755684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 574/1147] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:46.762586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.773125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a4008-7996-4e53-9e39-c29c5b76f6c9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.777685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.778278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.778559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.778835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.779587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:46.779885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.781771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dcf80-32b9-4bfb-8775-cc08af085dbb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.796131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 574/1148] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:46.802778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:46.813867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855e18-4bc8-4c33-9bc3-ce0059d2ea37 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:46.819889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:46.821042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:46.821394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:46.821671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/330a0223f48d4b03bc84c07e34ec62a1/roles/852684ea01d74d47b176096f6297c602` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:46.845467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=330a0223f48d4b03bc84c07e34ec62a1, role_id=852684ea01d74d47b176096f6297c602)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:46.848306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f91a6-692f-4763-a0d0-92bba4b1b0c6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:46.866710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 575/1149] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:48:46 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/330a0223f48d4b03bc84c07e34ec62a1/roles/852684ea01d74d47b176096f6297c602 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:48:49.070919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0948-dc0f-44f4-abd1-f1866d321f37 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.071930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0948-dc0f-44f4-abd1-f1866d321f37 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.071930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf0948-dc0f-44f4-abd1-f1866d321f37 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.073836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 575/1150] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:49.080149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.080805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.080805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.104934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:49.106191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:49.178422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 576/1151] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:49 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:49.203336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf0948-dc0f-44f4-abd1-f1866d321f37 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.216762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf0948-dc0f-44f4-abd1-f1866d321f37 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.221858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.222602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.222911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.223195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.237929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:49.244456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 12:48:49.245673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 576/1152] 10.222.0.60 () {56 vars in 1123 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:49.256732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.273785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851782-5cbb-48f9-b992-69de616041fb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.281511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.282595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.283096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.283787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.285181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.285732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.288758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.306196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 577/1153] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:49.312626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.324367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4251bb-b1c9-4888-8150-32ce5bb72a73 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.330446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.331209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.331489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.331735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.345055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.346968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.366093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:49.367376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 577/1154] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:49.374348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.385582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98077f9-10cf-490f-99dd-e38562ef09a2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.390707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.391403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.391889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.392285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.393116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.393465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.395582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.410645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 578/1155] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:49.417224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.427783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcd13-8fca-4a22-9b10-3771e476489f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.432742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.433475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.433804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.434127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.449277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.451497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.472403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:49.473913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 578/1156] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:49.480683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.492031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7370c-6a45-42bf-a26e-d47fe0e05825 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.497323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.498004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.498331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.498650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.499506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.499846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.502340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.536603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 579/1157] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:49.542857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.554022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e1cd9-3789-431f-83db-002d119abf39 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.559166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.559763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.560048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.560367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.570121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.572299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.582929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 579/1158] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:48:49.589523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.599859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181509b-0e8e-439b-b79e-391bd477afd0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.604759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.605508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.605789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.606063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.619182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.621245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.639812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:49.641004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 580/1159] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:49.648012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.658113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ba78e-21a3-4510-9796-3ef158c91d1a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.663303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.663906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.664189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.664501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.665209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.665515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.667114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.681671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 580/1160] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:49.688270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.698660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1162-e483-46d8-b813-05ddfce2ca66 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.703621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.704679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.704872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.705132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.715157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.717231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.732309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:49.733622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 581/1161] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:49.740259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.750374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b94e0-ad8a-489c-8989-0680f9230a36 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.755475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.756073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.756388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.756667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.757435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.757733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.759604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1783f-a9da-43a2-94f3-866c83ce5aa4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.774580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 581/1162] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:49.781385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:49.792197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7d49e-ee9b-471e-842b-6fca10d2ad5c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:49.797319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:49.798023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:49.798497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:49.798864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:49.799728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] RBAC: Adding query filter params (role.id=852684ea01d74d47b176096f6297c602, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=330a0223f48d4b03bc84c07e34ec62a1) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:49.800093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:49.802108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a390254-9599-401d-8280-1e89e3fbd90f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:49.809258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 582/1163] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:48:49 2021] GET /identity/v3/role_assignments?user.id=330a0223f48d4b03bc84c07e34ec62a1&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=852684ea01d74d47b176096f6297c602 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.045368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e088-7afe-48fa-a4bf-7cf047efec9d None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.046142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e088-7afe-48fa-a4bf-7cf047efec9d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.046142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4e088-7afe-48fa-a4bf-7cf047efec9d None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.047815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 582/1164] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:52.058053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.058662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.058823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.095058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:52.097122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:52.111429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 583/1165] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:52.135817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4e088-7afe-48fa-a4bf-7cf047efec9d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.150030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4e088-7afe-48fa-a4bf-7cf047efec9d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.155274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.156028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.156302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.156606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.170836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:52.177292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:48:52.178495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 583/1166] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:52.185526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.195330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08df0-3063-4a24-9a10-ca76ddacea05 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.200863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.201489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.201769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.202039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.202779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.203082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.205027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.215119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 584/1167] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.221931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.234507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82982-6e25-4135-8f22-378756227544 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.240722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.241487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.241765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.242036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.256514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.258406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.279172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:52.280383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 584/1168] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:52.287959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.303194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7273a35-2e35-4da5-9d4a-923ff60c7e01 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.308219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.308872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.309150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.309420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.310104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.310397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.312001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.325981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 585/1169] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.332536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.343001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7decb0-9e44-4b9a-b1a5-14967e900863 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.349096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.349791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.350067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.350337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.365151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.367218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.386752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:52.387925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 585/1170] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/users/placement => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:52.394802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.405061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69fea-d55e-4664-a576-14e0256e863f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.412271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.412891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.413173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.413445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.414252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.414549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.416507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.460519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 586/1171] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.467528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.484516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdae8d-95d3-4470-a0db-23e34ee92900 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.491629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.492662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.493153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.493655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.509749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.513214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.534252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 586/1172] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:48:52.540957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.552284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d11cb-a07d-4d11-b7a6-9e8429417e80 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.557031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.557769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.558059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.558337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.571607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.573522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.591882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:52.593173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 587/1173] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:52.599767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.608926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679cf47-502a-4f9c-9f95-c757276513e8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.613568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.614128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.614412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.614714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.615404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.615767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.617347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.632469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 587/1174] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.638860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.650697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a235bee-7140-4c30-845a-6889fa7e8c90 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.655061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.655810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.656125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.656437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.666840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.668852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.683460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:52.684691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 588/1175] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:52.692447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.702801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad167af-ecf2-4d5c-a129-b45fd629d9cf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.707989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.708678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.708962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.709242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.710028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.710349 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.712267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec246-1b7a-4963-8f28-e605476639eb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.726960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 588/1176] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:52.734701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:52.745217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430b90-5399-47a8-9c32-8051c3ede89e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:52.749728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:52.750457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:52.750810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:52.751271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:52.752319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=330a0223f48d4b03bc84c07e34ec62a1) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:52.752672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:52.754847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775bcdc7-bfbf-48f3-9218-59e230c5c4b6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:52.762528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 589/1177] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:48:52 2021] GET /identity/v3/role_assignments?user.id=330a0223f48d4b03bc84c07e34ec62a1&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:54.909808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b08d-5ee5-4b2e-88d7-fb1f6f8bd123 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:54.910412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b08d-5ee5-4b2e-88d7-fb1f6f8bd123 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:54.910412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b08d-5ee5-4b2e-88d7-fb1f6f8bd123 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:54.912235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 589/1178] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:54.918265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:54.918822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:54.918822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:54.943952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:54.945194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:54.953630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 590/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:54 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:54.977371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7b08d-5ee5-4b2e-88d7-fb1f6f8bd123 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:54.990795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7b08d-5ee5-4b2e-88d7-fb1f6f8bd123 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:54.995685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:54.996529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:54.996860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:54.997185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.010628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:55.017157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:48:55.018386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 590/1180] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:48:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:55.026177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.042686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8a336-180c-4cf5-82c7-f65f9e314114 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.049807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.050866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.051342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.051778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.053058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:55.053576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.056685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.072383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 591/1181] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:55.078665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.089966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2047f5-a629-4558-a532-20103d5ebb2a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.096108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.096886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.097168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.097442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.111281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.113216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.132710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:55.134066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 591/1182] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:55.140866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.151902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189511f-0f52-4024-a42d-a649289a307e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.157931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.158606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.159033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.159370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.160130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:55.160565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.162263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.176990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 592/1183] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:55.183290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.193669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954408e7-4774-4a06-b493-8699c1f059de admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.198313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.199111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.199442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.199758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.213906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.215960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.235838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:55.237090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 592/1184] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:55.243915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.254724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41f4e3-88c0-43d8-ab8c-8a6781f15b93 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.260083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.260843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.261136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.261573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.262623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:55.263025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.265343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.319575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 593/1185] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:55.326114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.336856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965ad9-9e08-4770-b037-c89acd17f80f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.342285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.342972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.343257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.343543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.358257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.360436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.379970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:55.381216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 593/1186] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:48:55.388489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.399745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52001-ec1a-475c-ac37-a2dbd2cf233d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.404893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.405602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.405956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.406281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.407091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:55.407551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.409688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.424357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 594/1187] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:55.431009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.441825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c97d3-39b8-42d1-a96f-850cc6ff775e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.446455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.447214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.447508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.447788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.458113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.460126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.475285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:55.476543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 594/1188] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:48:55.482985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.494456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce046206-88cd-4132-9921-304f8e9f3638 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.499319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.500018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.500442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.500783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.501888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:55.502239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.504262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a659-0455-4cd4-9a9c-3c2a56a179ab admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.518736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 595/1189] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:55.525949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:55.536127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509904ba-d43b-4e3e-b4fc-713196901c39 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:55.540590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:55.541416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:55.541702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:55.541984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] PATH_INFO: `/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/330a0223f48d4b03bc84c07e34ec62a1/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:55.543803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60daf20d62b04791a1ef39231d6b25d1, user_id=330a0223f48d4b03bc84c07e34ec62a1, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:55.546498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb756ac-4728-4cef-b948-f8fbc67d0044 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:55.563218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 595/1190] 10.222.0.60 () {58 vars in 1460 bytes} [Tue Nov 23 12:48:55 2021] PUT /identity/v3/projects/60daf20d62b04791a1ef39231d6b25d1/users/330a0223f48d4b03bc84c07e34ec62a1/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:48:57.772433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa81b-4bee-41dc-ab20-230726b2f253 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:57.773328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa81b-4bee-41dc-ab20-230726b2f253 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:57.773328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa81b-4bee-41dc-ab20-230726b2f253 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:57.775357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 596/1191] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:48:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:48:57.781984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:57.783201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:57.783302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:57.808295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:48:57.809443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:48:57.881566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 596/1192] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:48:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:48:57.906462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa81b-4bee-41dc-ab20-230726b2f253 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:57.920720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa81b-4bee-41dc-ab20-230726b2f253 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:57.925827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:57.926569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:57.926849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:57.927122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:57.944870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 12:48:57.958003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 12:48:57.960150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 597/1193] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Nov 23 12:48:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:57.967670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:57.978048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6c6f0-4292-405f-8f5a-7308cb36ffd3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:57.983794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:57.984481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:57.984762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:57.985044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:57.986318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:57.986612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:57.988283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:57.998331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 597/1194] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Nov 23 12:48:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:58.005556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.017326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e30f-2ee6-4010-895c-b2096531e6b0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.023438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.024098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.024423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.024706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.038527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.040658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.061187 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:58.062429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 598/1195] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:58.069105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.079537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f0d7-c2fc-41c9-bd55-7082ae30be37 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.084654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.085258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.085544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.085822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.086526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:58.086823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.088459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.102998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 598/1196] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:58.109612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.120195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b833b1-c9cc-4887-a820-0178aa13a229 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.125146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.125913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.130041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.130449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.147370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.149539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.169030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 12:48:58.170270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 599/1197] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 12:48:58.178280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.190233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba94b04-0e91-4380-b256-447ed6875690 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.196103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.196857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.197179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.197553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.198846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:58.199426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.202193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.240810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 599/1198] 10.222.0.60 () {56 vars in 1164 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:58.247214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.258296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beba38-2f72-479b-ba95-c3ea83cc6080 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.263950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.264623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.264944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.265303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.275849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.277775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.288951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 600/1199] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:48:58.295424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.306681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af77d8b-85ac-40aa-8aa2-c926df0c36f0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.311853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.312640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.312936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.313214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.328227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.330476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.349944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 12:48:58.351251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 600/1200] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:58.357856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.368737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51573d-ca61-413f-827b-af4164dad2bd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.375133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.375749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.376101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.377026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.377853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:58.378152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.380139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.396277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 601/1201] 10.222.0.60 () {56 vars in 1130 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:48:58.405768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.416146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47693-9c39-4278-8f7d-3904865cc246 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.421077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.421807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.422077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.422382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.432727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.434877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.450239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING keystone.server.flask.application [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 12:48:58.451453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 601/1202] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:48:58.458836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.470445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663652f-9c66-4465-ac21-b238123096f1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.476797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.477606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.477922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.478266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.479146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:58.479418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.481726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10204-ffb2-4f7d-864c-3424f7f9bff4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.496631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 602/1203] 10.222.0.60 () {56 vars in 1169 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:48:58.506638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:48:58.517656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b36ab-bcbb-4932-b45d-13afd9515255 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:48:58.524038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:48:58.524687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:48:58.524972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:48:58.525249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:48:58.526103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] RBAC: Adding query filter params (role.id=49ff45bcbfb8403790f45aa211a11ca9, scope.project.id=60daf20d62b04791a1ef39231d6b25d1, user.id=330a0223f48d4b03bc84c07e34ec62a1) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:48:58.526359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:48:58.528296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9e38-d4cc-4b1e-afa5-e0bb35d54d70 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:48:58.535473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 602/1204] 10.222.0.60 () {56 vars in 1395 bytes} [Tue Nov 23 12:48:58 2021] GET /identity/v3/role_assignments?user.id=330a0223f48d4b03bc84c07e34ec62a1&scope.project.id=60daf20d62b04791a1ef39231d6b25d1&role.id=49ff45bcbfb8403790f45aa211a11ca9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:49:00.857599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1a9f-7eb7-418b-9947-28f282378e53 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:00.858155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1a9f-7eb7-418b-9947-28f282378e53 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:00.858155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c1a9f-7eb7-418b-9947-28f282378e53 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:00.859921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 603/1205] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:49:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:49:00.867286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:00.867873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:00.868345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:00.903757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:49:00.905763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:49:00.919616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 603/1206] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:49:00 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:49:00.958960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c1a9f-7eb7-418b-9947-28f282378e53 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:00.973186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c1a9f-7eb7-418b-9947-28f282378e53 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:00.978386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:00.979168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:00.979450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:00.979721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:00.980388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:00.982053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:00.994063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 12:49:00.995346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 604/1207] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:49:00 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:49:01.002478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:01.012614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9bbf4-56dd-4ba5-8189-3b565abf2a5c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:01.018637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:01.019261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:01.019915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:01.020192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:01.020957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:49:01.021279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:01.022978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d129acb-87f4-4d23-80cc-c6e652658f13 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:01.029105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 604/1208] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Nov 23 12:49:01 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:49:01.036438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:01.046963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09d6d9-de23-471b-9a14-2fa2373cd9de admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:01.052369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:01.052995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:01.053275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:01.053548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] PATH_INFO: `/v3/services` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:01.054348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:49:01.054649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:01.056401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd025-6419-4d3d-8493-f90af6fa65c9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:01.062031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 605/1209] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Nov 23 12:49:01 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:49:03.236557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2984b-529e-4888-8241-c5fff77fa6ee None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:03.237160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2984b-529e-4888-8241-c5fff77fa6ee None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:03.237160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2984b-529e-4888-8241-c5fff77fa6ee None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:03.238936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 605/1210] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:49:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:49:03.246957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37388ffc-2ff0-4507-9202-992e8785b78c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:03.247546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37388ffc-2ff0-4507-9202-992e8785b78c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:03.247881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37388ffc-2ff0-4507-9202-992e8785b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:03.273779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-37388ffc-2ff0-4507-9202-992e8785b78c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:49:03.275135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-37388ffc-2ff0-4507-9202-992e8785b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:49:03.283542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 606/1211] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:49:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:49:03.307375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2984b-529e-4888-8241-c5fff77fa6ee None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:03.320926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2984b-529e-4888-8241-c5fff77fa6ee None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:03.325827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:03.326449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:03.326734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:03.327012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:03.327705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:03.329482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e3a29-9192-4f37-aba2-857c6ae885f8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:03.346500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 606/1212] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Nov 23 12:49:03 2021] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:49:05.551598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2ddf-1be5-4789-bca5-062f429dd623 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.552199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2ddf-1be5-4789-bca5-062f429dd623 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.552199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2ddf-1be5-4789-bca5-062f429dd623 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.554033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 607/1213] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:49:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:49:05.560439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.561003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.561003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.586607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:49:05.587789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:49:05.613542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 607/1214] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:49:05 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:49:05.636733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b2ddf-1be5-4789-bca5-062f429dd623 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:05.651313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b2ddf-1be5-4789-bca5-062f429dd623 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:05.656495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:05.657411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.657746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.658027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.658756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:05.660515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:05.672358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 12:49:05.673715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 608/1215] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:49:05 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:49:05.680547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:05.690363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bf6df-1458-46b9-8b57-e7a557a6b90f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:05.696210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:05.696967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.697304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.697640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.698433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:49:05.698709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:05.700646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:05.707254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 608/1216] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Nov 23 12:49:05 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:49:05.714205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:05.725893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad46e-afb8-46a5-8f23-c71923af018a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:05.730904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:05.731606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.731934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.732266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.733158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] RBAC: Adding query filter params (interface=public, service_id=2d0b7362669146f7a2312ceab3cf5d9a, region_id=RegionOne) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:49:05.733527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:05.735366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499f33b-1170-432d-a982-8bc33dee1135 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:05.741833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 609/1217] 10.222.0.60 () {56 vars in 1272 bytes} [Tue Nov 23 12:49:05 2021] GET /identity/v3/endpoints?service_id=2d0b7362669146f7a2312ceab3cf5d9a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:49:05.748391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:05.758772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc047d9d-60b3-41ea-a72e-b3c503f1348f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:05.764067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:05.764850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:05.765204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:05.765529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:05.766250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:05.768152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad67030-c0ac-4be1-8f99-7ef7e21bb4ac admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:05.776745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 609/1218] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:49:05 2021] GET /identity/v3/services => generated 2430 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:49:08.306680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c96e-4a92-4e37-b1fd-b070b5d31da9 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:08.307293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c96e-4a92-4e37-b1fd-b070b5d31da9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:08.307293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c96e-4a92-4e37-b1fd-b070b5d31da9 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:08.309106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 610/1219] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:49:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:49:08.315388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:08.315988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:08.315988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:08.340173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:49:08.341390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:49:08.349928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 610/1220] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:49:08 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:49:08.375193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c96e-4a92-4e37-b1fd-b070b5d31da9 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:08.396897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c96e-4a92-4e37-b1fd-b070b5d31da9 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:08.403694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:08.404782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:08.405192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:08.405580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:08.406723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:08.409883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:08.430094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING keystone.server.flask.application [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 12:49:08.431905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 611/1221] 10.222.0.60 () {56 vars in 1138 bytes} [Tue Nov 23 12:49:08 2021] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 12:49:08.439202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:08.449129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168b6c1-12ab-4739-a327-65da8fde8cad None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:08.455315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:08.455936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:08.456220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:08.456533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] PATH_INFO: `/v3/services` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:08.457227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:49:08.457524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:08.459216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72a32b-37a2-4fb6-91c7-444fdacf4953 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:08.465769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 611/1222] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Nov 23 12:49:08 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:49:08.473805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:49:08.485387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f77e46-2229-4e99-947b-05dbacb25eb9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:49:08.491687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:49:08.492360 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:49:08.492647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:49:08.492924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:49:08.493633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:49:08.495583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c2884-5627-4ae6-b90a-46499337ed56 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:49:08.519133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 612/1223] 10.222.0.60 () {60 vars in 1165 bytes} [Tue Nov 23 12:49:08 2021] POST /identity/v3/endpoints => generated 331 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:50:41.270786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:41.271408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:41.271538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:41.273389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 612/1224] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:41.279293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5dfc-6315-49e4-90d3-e284991b0cad None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:41.279812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5dfc-6315-49e4-90d3-e284991b0cad None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:41.279812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5dfc-6315-49e4-90d3-e284991b0cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:41.374132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e84a5dfc-6315-49e4-90d3-e284991b0cad None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:41.375439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e84a5dfc-6315-49e4-90d3-e284991b0cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:41.490172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 613/1225] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:41.513300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:41.515051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:41.665281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03438-d4d9-4f32-830b-17a2baef81a5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:41.780712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:41.781426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:41.781782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:41.782147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:41.782942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:41.785005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc37ec-7db6-4bf4-843d-57c68356df12 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:41.800267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 613/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:50:41 2021] GET /identity/v3/projects => generated 2553 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:50:43.977027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44ac4-ed76-4dab-9338-18413f15366a None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:43.977651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44ac4-ed76-4dab-9338-18413f15366a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:43.977651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff44ac4-ed76-4dab-9338-18413f15366a None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:43.979357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 614/1227] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:43.986965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d004-a385-48fd-8c94-98990661267d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:43.987522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d004-a385-48fd-8c94-98990661267d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:43.987522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d004-a385-48fd-8c94-98990661267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:44.084657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4514d004-a385-48fd-8c94-98990661267d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:44.085927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4514d004-a385-48fd-8c94-98990661267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:44.203903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 614/1228] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:44.261403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:44.261687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:44.261965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:44.263703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 615/1229] 10.222.0.60 () {54 vars in 963 bytes} [Tue Nov 23 12:50:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:44.272277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5daacb-c864-4300-95d6-ea6255785f3f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:44.272580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5daacb-c864-4300-95d6-ea6255785f3f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:44.272865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5daacb-c864-4300-95d6-ea6255785f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:44.387473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ea5daacb-c864-4300-95d6-ea6255785f3f None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:44.388681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ea5daacb-c864-4300-95d6-ea6255785f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:44.482509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 615/1230] 10.222.0.60 () {58 vars in 1060 bytes} [Tue Nov 23 12:50:44 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:44.496426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:44.497887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:44.623826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591b9b-b514-4b6a-8334-9ba9dde90261 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:44.708578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:44.709158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:44.709448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:44.709725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:44.711292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:44.849211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:44.850674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672c98d-1ea6-4027-9ea6-9888aaf15a73 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:44.872115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 616/1231] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:50:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:50:47.250331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:47.250853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:47.251034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:47.252746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 616/1232] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:47.258419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab923f-9a25-423d-bc22-71f21872ddf9 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:47.258878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab923f-9a25-423d-bc22-71f21872ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:47.258972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab923f-9a25-423d-bc22-71f21872ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:47.352870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4cab923f-9a25-423d-bc22-71f21872ddf9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:47.354056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4cab923f-9a25-423d-bc22-71f21872ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:47.488953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 617/1233] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:47.528937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:47.530837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:47.675601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e88a-66f7-4ac8-9e6f-12320592b0bb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:47.776669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:47.777166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:47.777456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:47.777731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:47.779310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:47.910320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:47.911760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808885-af12-4805-81c1-4ef5cb038513 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:47.931443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 617/1234] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:50:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:50:50.368494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:50.369408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:50.369408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:50.372311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 618/1235] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:50.381838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4b3a-20c2-41e3-b9c9-07d4396307b5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:50.382323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4b3a-20c2-41e3-b9c9-07d4396307b5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:50.382425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4b3a-20c2-41e3-b9c9-07d4396307b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:50.483070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8eed4b3a-20c2-41e3-b9c9-07d4396307b5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:50.484266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8eed4b3a-20c2-41e3-b9c9-07d4396307b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:50.597585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 618/1236] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:50.631665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:50.633082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:50.802215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14b20-15bc-4e97-a8ca-d0f4dfbe5319 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:50.910744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:50.911427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:50.911734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:50.911985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:50.924214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:50.926423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fb8ce-3dd5-45d5-a1df-25b1490ea39f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:50.928133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 619/1237] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:50:50 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:50:50.955402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:50.955663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:50.956313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:50.957723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 619/1238] 10.222.0.60 () {54 vars in 963 bytes} [Tue Nov 23 12:50:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:50.966435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842bc27-3eaa-42ef-b746-bfcad5728849 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:50.966715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842bc27-3eaa-42ef-b746-bfcad5728849 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:50.966989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842bc27-3eaa-42ef-b746-bfcad5728849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:51.069726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e842bc27-3eaa-42ef-b746-bfcad5728849 None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:51.070905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e842bc27-3eaa-42ef-b746-bfcad5728849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:51.175110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 620/1239] 10.222.0.60 () {58 vars in 1060 bytes} [Tue Nov 23 12:50:50 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:51.184478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:51.185979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:51.312944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400475e7-7131-4d18-9a0a-1aa55c5f79ab None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:51.398203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:51.398908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:51.399009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:51.399305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:51.400904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:51.523347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:51.524731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f89e72-04ca-4369-b9db-28341a2f8aea service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:51.546890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 620/1240] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:50:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:50:54.669701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:54.670339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:54.670339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:54.671978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 621/1241] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:54.678584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:54.679315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:54.679424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:54.782568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:54.783972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:54.897067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 621/1242] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:54.930671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:54.932052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:55.100987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f260b-597a-4929-9f04-75d11f5955f5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:55.208921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:55.209632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:55.209917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:55.210196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:55.222158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:55.224268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8601-d5f1-4a85-8f66-fb855359c351 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:55.225935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 622/1243] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:50:54 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:50:55.239459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:55.240660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:55.352141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04426238-cd63-4f2a-9dc8-de627a434bf5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:55.446950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:55.447554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:55.447832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:55.448098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:55.449705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:55.584090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:55.585606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f6505-5ed0-492b-90ab-f73b17d5f815 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:55.606869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 622/1244] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:50:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:50:58.576959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561348-b807-4eed-9e04-30f2888789aa None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:58.577528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561348-b807-4eed-9e04-30f2888789aa None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:58.577528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561348-b807-4eed-9e04-30f2888789aa None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:58.579253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 623/1245] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:50:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:50:58.584942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce0c5f-edc6-499e-a52e-5f104b89111f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:58.585398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce0c5f-edc6-499e-a52e-5f104b89111f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:58.585521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce0c5f-edc6-499e-a52e-5f104b89111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:58.677357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cbce0c5f-edc6-499e-a52e-5f104b89111f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:50:58.678505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cbce0c5f-edc6-499e-a52e-5f104b89111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:58.795240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 623/1246] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:50:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:50:58.832867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561348-b807-4eed-9e04-30f2888789aa None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:50:58.834386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-72561348-b807-4eed-9e04-30f2888789aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:58.973446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561348-b807-4eed-9e04-30f2888789aa None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:50:59.070644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:50:59.071233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:50:59.071519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:50:59.071796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:50:59.073412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:50:59.207379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:50:59.208824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969590f0-c816-48ad-9933-a45e79d5f229 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:50:59.229745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 624/1247] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:50:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:51:01.437961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:01.438462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:01.438570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:01.441035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 624/1248] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:51:01.446932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacc30-a766-41cb-908a-cbfc2ed65be3 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:01.447399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacc30-a766-41cb-908a-cbfc2ed65be3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:01.447490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacc30-a766-41cb-908a-cbfc2ed65be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:01.542091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-42dacc30-a766-41cb-908a-cbfc2ed65be3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:01.543268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-42dacc30-a766-41cb-908a-cbfc2ed65be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:01.661416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 625/1249] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:01.698881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:01.701706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:01.844188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022c973-25f3-416a-95fa-08a330da2775 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:01.952317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:01.952932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:01.953217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:01.953502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:01.955233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:02.124435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:02.126337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316a81-62d6-4d86-b60e-11463418fc05 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:02.151471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 625/1250] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:04.387704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:04.388282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:04.388282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:04.390738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 626/1251] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:04.396874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:04.397342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:04.397431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:04.485914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:04.487008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:04.604496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 626/1252] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:04.638149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:04.639601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:04.792093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d0b2a-5be6-4127-b14e-a428482b9658 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:04.902764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:04.903554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:04.903832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:04.904100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:04.915586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:04.917685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c98d-95e1-47e3-8bca-50598089fa95 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:04.919358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 627/1253] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:51:04 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:51:04.932064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:04.933255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:05.051145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd9e6-2253-45db-870c-116e56ef0dc0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:05.138797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:05.139379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:05.139664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:05.139944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:05.141524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:05.271343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:05.272841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd03e-3543-45f0-8b88-d8b8adaed5f7 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:05.293335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 627/1254] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:07.707370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:07.707923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:07.707923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:07.710185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 628/1255] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:07.716930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57be2-f4ed-470a-9488-186cc0a07bc5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:07.717440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57be2-f4ed-470a-9488-186cc0a07bc5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:07.717554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57be2-f4ed-470a-9488-186cc0a07bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:07.817275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d2d57be2-f4ed-470a-9488-186cc0a07bc5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:07.818512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d2d57be2-f4ed-470a-9488-186cc0a07bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:07.961311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 628/1256] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:07.998099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:07.999597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:08.135048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d532ef-3314-43ba-bc1a-a22db594dd12 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:08.230890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:08.231383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:08.231669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:08.231952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:08.233627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:08.370371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:08.371821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c8da-9263-4610-990a-781ea251a7e2 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:08.393393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 629/1257] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:10.615726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:10.616625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:10.616625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:10.619338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 629/1258] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:10.626753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde0bc-64a4-46a0-8b42-744eebc55210 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:10.627711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde0bc-64a4-46a0-8b42-744eebc55210 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:10.627711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde0bc-64a4-46a0-8b42-744eebc55210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:10.722895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-04dde0bc-64a4-46a0-8b42-744eebc55210 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:10.724088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-04dde0bc-64a4-46a0-8b42-744eebc55210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:10.837565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 630/1259] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:51:10.882229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:10.883693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:11.012133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657ba52-6cc5-44a6-8d29-800743e97dba None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:11.106976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:11.107726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:11.108117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:11.108584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:11.110325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:11.244510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:11.245889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016edf-1333-46d6-9439-a0e29f7a1104 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:11.265740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 630/1260] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:13.842899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:13.843520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:13.843520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:13.845279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 631/1261] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:13.851312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd98c56-81bc-4190-90f9-e8d527d99941 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:13.852014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd98c56-81bc-4190-90f9-e8d527d99941 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:13.852014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd98c56-81bc-4190-90f9-e8d527d99941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:13.965090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-afd98c56-81bc-4190-90f9-e8d527d99941 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:13.966259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-afd98c56-81bc-4190-90f9-e8d527d99941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:14.090522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 631/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:14.130831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:14.133217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:14.268375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d38b5-b137-4bfb-badd-9f83bb7d3362 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:14.272511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:14.273078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:14.273366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:14.273639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:14.284079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:14.285576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd4f8-1d94-40e9-b49c-01804c721e73 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:14.294954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 632/1263] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:19.195784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b7aa1-543f-4ab4-ac4c-7a3c238bb001 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:19.196331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b7aa1-543f-4ab4-ac4c-7a3c238bb001 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:19.196463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b7aa1-543f-4ab4-ac4c-7a3c238bb001 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:19.198512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 632/1264] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:19.205059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20cfd-6257-42ae-9f55-99f3d9a4fff0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:19.205614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20cfd-6257-42ae-9f55-99f3d9a4fff0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:19.205879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20cfd-6257-42ae-9f55-99f3d9a4fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:19.230871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-17c20cfd-6257-42ae-9f55-99f3d9a4fff0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:19.232107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-17c20cfd-6257-42ae-9f55-99f3d9a4fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:19.240017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 633/1265] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:51:19.281249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b7aa1-543f-4ab4-ac4c-7a3c238bb001 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:19.294307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b7aa1-543f-4ab4-ac4c-7a3c238bb001 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:19.298902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:19.299489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:19.299769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:19.300043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:19.316546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:19.316546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878611-cef8-4dcb-a77c-1b7fe1242dfb service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:19.323412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 633/1266] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:22.405380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:22.405987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:22.405987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:22.407731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 634/1267] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:22.414149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c3d5-ff5b-4924-8453-af55237e48db None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:22.414744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c3d5-ff5b-4924-8453-af55237e48db None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:22.414744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944c3d5-ff5b-4924-8453-af55237e48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:22.441901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8944c3d5-ff5b-4924-8453-af55237e48db None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:22.443075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8944c3d5-ff5b-4924-8453-af55237e48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:22.452776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 634/1268] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:22.502233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:22.504776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:22.523942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b810be3-d6f8-42fe-9b00-c6ed3cfa2638 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:22.528861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:22.529437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:22.529722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:22.529997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:22.540265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:22.541728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea892d-8d01-4faa-a911-7f1c82a76711 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:22.552199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 635/1269] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:27.834895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d499c-867d-452e-88e0-578990d77467 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:27.835854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d499c-867d-452e-88e0-578990d77467 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:27.836117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d499c-867d-452e-88e0-578990d77467 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:27.837847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 635/1270] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:27.843969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46bda-2df3-4d0d-9328-abb66f597584 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:27.844558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46bda-2df3-4d0d-9328-abb66f597584 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:27.844639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46bda-2df3-4d0d-9328-abb66f597584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:27.868963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-91d46bda-2df3-4d0d-9328-abb66f597584 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:27.870283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-91d46bda-2df3-4d0d-9328-abb66f597584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:27.878698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 636/1271] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:27.919380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d499c-867d-452e-88e0-578990d77467 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:27.934142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d499c-867d-452e-88e0-578990d77467 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:27.940044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:27.941255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:27.941732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:27.942213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:27.958348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:27.959823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c86e35-2587-47f2-a1fd-c46aec5c5e27 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:27.972687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 636/1272] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:32.779654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d150-a65b-460f-85e7-727fae8001dc None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:32.780195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d150-a65b-460f-85e7-727fae8001dc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:32.780195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d150-a65b-460f-85e7-727fae8001dc None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:32.784738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 637/1273] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:51:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:32.792199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d055-f184-4ec7-bdce-a230355ba909 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:32.793953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d055-f184-4ec7-bdce-a230355ba909 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:32.794480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d055-f184-4ec7-bdce-a230355ba909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:32.957284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-38e5d055-f184-4ec7-bdce-a230355ba909 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:32.959739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-38e5d055-f184-4ec7-bdce-a230355ba909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:33.097326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 637/1274] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:51:32 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:33.568902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a634-b74c-46dc-bc7c-3429d9218222 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:33.569727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a634-b74c-46dc-bc7c-3429d9218222 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:33.570366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a634-b74c-46dc-bc7c-3429d9218222 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:33.573556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 638/1275] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:51:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:33.578768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c6a0-2c1b-45dc-9b43-9254c4b8e983 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:33.579062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c6a0-2c1b-45dc-9b43-9254c4b8e983 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:33.579389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532c6a0-2c1b-45dc-9b43-9254c4b8e983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:33.614983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1532c6a0-2c1b-45dc-9b43-9254c4b8e983 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:33.617599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1532c6a0-2c1b-45dc-9b43-9254c4b8e983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:33.646269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 638/1276] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:51:33 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:38.286170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74149e-3df3-46f3-9cb6-65c1b879b61d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:38.286743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74149e-3df3-46f3-9cb6-65c1b879b61d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:38.286743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74149e-3df3-46f3-9cb6-65c1b879b61d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:38.288949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 639/1277] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:38.294595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7ec-0dc7-4955-b4de-51bb29608477 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:38.295172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7ec-0dc7-4955-b4de-51bb29608477 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:38.295172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7ec-0dc7-4955-b4de-51bb29608477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:38.320922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8d0ec7ec-0dc7-4955-b4de-51bb29608477 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:38.322248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8d0ec7ec-0dc7-4955-b4de-51bb29608477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:38.333292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 639/1278] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:51:38 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:40.069285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af8e5-a114-4549-93fe-e6d1691021a2 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:40.070074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af8e5-a114-4549-93fe-e6d1691021a2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:40.070074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af8e5-a114-4549-93fe-e6d1691021a2 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:40.073256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 640/1279] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:51:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:40.079018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad831a4-79ae-4d29-8b3b-54d89c810348 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:40.079802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad831a4-79ae-4d29-8b3b-54d89c810348 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:40.079802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad831a4-79ae-4d29-8b3b-54d89c810348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:40.106677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-bad831a4-79ae-4d29-8b3b-54d89c810348 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:40.107883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-bad831a4-79ae-4d29-8b3b-54d89c810348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:40.119180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 640/1280] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:51:40 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:44.925755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c943c-59db-43a7-b77b-f319707e4e9d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:44.926608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c943c-59db-43a7-b77b-f319707e4e9d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:44.926747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c943c-59db-43a7-b77b-f319707e4e9d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:44.928653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 641/1281] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:44.935116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe35-5f9b-44d0-98d2-925c0126cf4b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:44.935743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe35-5f9b-44d0-98d2-925c0126cf4b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:44.935743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fe35-5f9b-44d0-98d2-925c0126cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:44.966265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6807fe35-5f9b-44d0-98d2-925c0126cf4b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:44.968311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6807fe35-5f9b-44d0-98d2-925c0126cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:44.981378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 641/1282] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:51:45.060570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b55a-58fe-4b8d-9e1f-a9a6d4e86f61 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:45.061088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b55a-58fe-4b8d-9e1f-a9a6d4e86f61 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:45.061571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b55a-58fe-4b8d-9e1f-a9a6d4e86f61 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:45.065578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 642/1283] 10.222.0.60 () {54 vars in 959 bytes} [Tue Nov 23 12:51:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:45.071472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71fe7d-d949-4ecf-b42d-0cf92f34684e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:45.071967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71fe7d-d949-4ecf-b42d-0cf92f34684e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:45.072428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71fe7d-d949-4ecf-b42d-0cf92f34684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:45.177279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-fe71fe7d-d949-4ecf-b42d-0cf92f34684e None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:45.179712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fe71fe7d-d949-4ecf-b42d-0cf92f34684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:45.299841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 642/1284] 10.222.0.60 () {58 vars in 1056 bytes} [Tue Nov 23 12:51:45 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:45.309084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b55a-58fe-4b8d-9e1f-a9a6d4e86f61 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:45.324581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b55a-58fe-4b8d-9e1f-a9a6d4e86f61 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:45.330493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:45.331096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:45.331380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:45.331663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:45.345280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:45.347704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfdd4e-1605-4397-bbfa-a39a2a366bc4 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:45.360664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 643/1285] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:47.835064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e39e9-f1fe-4ed5-b911-b4e7f6fbc14c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:47.835925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e39e9-f1fe-4ed5-b911-b4e7f6fbc14c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:47.835925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e39e9-f1fe-4ed5-b911-b4e7f6fbc14c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:47.837425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 643/1286] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:51:47.843868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3ec5-1004-4b72-b626-67d7ec029fbc None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:47.844672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3ec5-1004-4b72-b626-67d7ec029fbc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:47.844869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3ec5-1004-4b72-b626-67d7ec029fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:47.880106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fa4e3ec5-1004-4b72-b626-67d7ec029fbc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:47.881334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fa4e3ec5-1004-4b72-b626-67d7ec029fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:47.889108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 644/1287] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:51:47.935707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e39e9-f1fe-4ed5-b911-b4e7f6fbc14c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:47.958535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e39e9-f1fe-4ed5-b911-b4e7f6fbc14c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:47.964726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:47.965330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:47.965607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:47.965877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:47.976374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:47.977691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a12bc-85d8-4994-a79a-9cb26a15c0b6 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:47.990216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 644/1288] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:50.717455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a4c-06b2-4712-9ab5-bad731bbb88d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:50.718026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a4c-06b2-4712-9ab5-bad731bbb88d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:50.718026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a4c-06b2-4712-9ab5-bad731bbb88d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:50.719852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 645/1289] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:50.726642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ab75-2192-478b-8010-6f8ddea40112 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:50.727422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ab75-2192-478b-8010-6f8ddea40112 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:50.727422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81ab75-2192-478b-8010-6f8ddea40112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:50.751829 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-fc81ab75-2192-478b-8010-6f8ddea40112 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:50.753178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fc81ab75-2192-478b-8010-6f8ddea40112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:50.760940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 645/1290] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:50.814734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb48b-f080-48c2-9806-d5cdbc3a70b0 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:50.815019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb48b-f080-48c2-9806-d5cdbc3a70b0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:50.815314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb48b-f080-48c2-9806-d5cdbc3a70b0 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:50.817122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 646/1291] 10.222.0.60 () {54 vars in 959 bytes} [Tue Nov 23 12:51:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:50.826291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b373-adc7-4656-83e8-27bd135e25ac None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:50.826564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b373-adc7-4656-83e8-27bd135e25ac None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:50.826853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b373-adc7-4656-83e8-27bd135e25ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:50.852793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7109b373-adc7-4656-83e8-27bd135e25ac None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:50.853972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7109b373-adc7-4656-83e8-27bd135e25ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:50.868592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 646/1292] 10.222.0.60 () {58 vars in 1056 bytes} [Tue Nov 23 12:51:50 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:50.877735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb48b-f080-48c2-9806-d5cdbc3a70b0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:50.893343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb48b-f080-48c2-9806-d5cdbc3a70b0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:50.898581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:50.899167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:50.899450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:50.899726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:50.908809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:50.910449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bef90-9f89-47be-ad08-90458f8daba2 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:50.920645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 647/1293] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:53.178138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d2c3-6590-4186-8b19-c684e0222fd9 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:53.179046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d2c3-6590-4186-8b19-c684e0222fd9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:53.179046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d2c3-6590-4186-8b19-c684e0222fd9 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:53.180907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 647/1294] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:53.189868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35884d-5de3-43e1-8b71-8487647b7630 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:53.190762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35884d-5de3-43e1-8b71-8487647b7630 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:53.190762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35884d-5de3-43e1-8b71-8487647b7630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:53.215262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-2f35884d-5de3-43e1-8b71-8487647b7630 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:53.216509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2f35884d-5de3-43e1-8b71-8487647b7630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:53.224603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 648/1295] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:53.271545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d2c3-6590-4186-8b19-c684e0222fd9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:53.287922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d2c3-6590-4186-8b19-c684e0222fd9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:53.293401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:53.293986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:53.294269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:53.294546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:53.304367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:53.305980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d6bd1-e1f7-40d5-bfd0-cc0377d16b1a service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:53.316413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 648/1296] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:55.545506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc73f4-9160-4271-b0f6-86cf1403b4ab None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:55.546097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc73f4-9160-4271-b0f6-86cf1403b4ab None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:55.546097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc73f4-9160-4271-b0f6-86cf1403b4ab None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:55.547880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 649/1297] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:55.555540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4b46-0255-4a67-ab58-33c98a691969 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:55.556049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4b46-0255-4a67-ab58-33c98a691969 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:55.556220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4b46-0255-4a67-ab58-33c98a691969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:55.584987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-14ab4b46-0255-4a67-ab58-33c98a691969 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:55.586196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-14ab4b46-0255-4a67-ab58-33c98a691969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:55.593928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 649/1298] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:55.644791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc73f4-9160-4271-b0f6-86cf1403b4ab None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:55.660108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc73f4-9160-4271-b0f6-86cf1403b4ab None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:55.665997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:55.666626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:55.667036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:55.667378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:55.677019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:55.678682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097200ff-f3ab-4351-8a6f-ceffe3543ae6 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:55.689545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 650/1299] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:51:57.958879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ade3-b5aa-4187-adc1-74339f340c10 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:57.959599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ade3-b5aa-4187-adc1-74339f340c10 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:57.959599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1ade3-b5aa-4187-adc1-74339f340c10 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:57.961182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 650/1300] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:51:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:51:57.967426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf580-840c-4b02-a403-a680ad316568 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:57.968071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf580-840c-4b02-a403-a680ad316568 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:57.968071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf580-840c-4b02-a403-a680ad316568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:57.994031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3eadf580-840c-4b02-a403-a680ad316568 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:51:57.995213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3eadf580-840c-4b02-a403-a680ad316568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:51:58.003325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 651/1301] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:51:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:51:58.050872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1ade3-b5aa-4187-adc1-74339f340c10 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:51:58.070659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1ade3-b5aa-4187-adc1-74339f340c10 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:51:58.077318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:51:58.078023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:51:58.078463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:51:58.078895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:51:58.091300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:51:58.092966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f2fc2-4d66-4277-9fcc-4878aa4d5c03 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:51:58.103291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 651/1302] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:51:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:00.381588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999830-9244-4424-8161-49cb1ea4d7a7 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:00.382202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999830-9244-4424-8161-49cb1ea4d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:00.382202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999830-9244-4424-8161-49cb1ea4d7a7 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:00.383848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 652/1303] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:00.389304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3182b5-bb47-4738-b46f-1eceef61a5a2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:00.389757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3182b5-bb47-4738-b46f-1eceef61a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:00.389867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3182b5-bb47-4738-b46f-1eceef61a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:00.426156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-de3182b5-bb47-4738-b46f-1eceef61a5a2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:00.430038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-de3182b5-bb47-4738-b46f-1eceef61a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:00.441242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 652/1304] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:00.485907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999830-9244-4424-8161-49cb1ea4d7a7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:00.502960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999830-9244-4424-8161-49cb1ea4d7a7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:00.509045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:00.509646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:00.509930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:00.510217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:00.520575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:00.522231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d04b39-aade-4b89-b255-b40cc1f24274 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:00.533268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 653/1305] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:52:02.770760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a28bf-2482-4f22-87e0-ac5a581b2e4c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:02.771644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a28bf-2482-4f22-87e0-ac5a581b2e4c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:02.771644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a28bf-2482-4f22-87e0-ac5a581b2e4c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:02.773124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 653/1306] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:02.781717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f7e6f-fc30-45fa-9b11-e15a2167cee0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:02.782490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f7e6f-fc30-45fa-9b11-e15a2167cee0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:02.782490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f7e6f-fc30-45fa-9b11-e15a2167cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:02.806760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-475f7e6f-fc30-45fa-9b11-e15a2167cee0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:02.807864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-475f7e6f-fc30-45fa-9b11-e15a2167cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:02.818827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 654/1307] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:02.865756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a28bf-2482-4f22-87e0-ac5a581b2e4c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:02.883024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a28bf-2482-4f22-87e0-ac5a581b2e4c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:02.889503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:02.890179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:02.890521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:02.890861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:02.900908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:02.902556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e08f-b95e-458b-8c35-ff7b06ba96a6 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:02.913428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 654/1308] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:05.132290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f0b3-5dc0-4681-b333-4dc3e3d9581c None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:05.132938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f0b3-5dc0-4681-b333-4dc3e3d9581c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:05.132938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f0b3-5dc0-4681-b333-4dc3e3d9581c None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:05.134605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 655/1309] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:05.141297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717bd6-0bfd-4e7b-a742-4766c7207943 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:05.142515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717bd6-0bfd-4e7b-a742-4766c7207943 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:05.142515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717bd6-0bfd-4e7b-a742-4766c7207943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:05.165186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d3717bd6-0bfd-4e7b-a742-4766c7207943 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:05.166346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d3717bd6-0bfd-4e7b-a742-4766c7207943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:05.174303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 655/1310] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:05.220733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f0b3-5dc0-4681-b333-4dc3e3d9581c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:05.236481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f0b3-5dc0-4681-b333-4dc3e3d9581c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:05.242081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:05.242671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:05.242940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:05.243225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:05.253600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:05.255242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9f8f-4e51-4a07-9fa6-1ce5df74121b service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:05.265617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 656/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:07.541359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d763-aabc-4883-8309-ce7bc4fa8a1b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:07.542411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d763-aabc-4883-8309-ce7bc4fa8a1b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:07.542411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d763-aabc-4883-8309-ce7bc4fa8a1b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:07.544444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 656/1312] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:07.551466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563a25-3717-4fb4-a8db-ee0d90504b1b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:07.552019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563a25-3717-4fb4-a8db-ee0d90504b1b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:07.552140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563a25-3717-4fb4-a8db-ee0d90504b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:07.577564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-eb563a25-3717-4fb4-a8db-ee0d90504b1b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:07.578926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-eb563a25-3717-4fb4-a8db-ee0d90504b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:07.586715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 657/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:07.633542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d763-aabc-4883-8309-ce7bc4fa8a1b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:07.649621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d763-aabc-4883-8309-ce7bc4fa8a1b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:07.659261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:07.660338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:07.660846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:07.661339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:07.670825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:07.672619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257b7ad-29ac-4a41-a623-a8beb5ccbcc3 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:07.684556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 657/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:09.987907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c92a4-4f6a-46f2-9155-919019c3d900 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:09.988844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c92a4-4f6a-46f2-9155-919019c3d900 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:09.988844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c92a4-4f6a-46f2-9155-919019c3d900 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:09.990561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 658/1315] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:52:09.996477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2dc7-bbd9-498e-9768-682fd5f17f1f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:09.997241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2dc7-bbd9-498e-9768-682fd5f17f1f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:09.997241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2dc7-bbd9-498e-9768-682fd5f17f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:10.020570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9ecf2dc7-bbd9-498e-9768-682fd5f17f1f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:10.022011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9ecf2dc7-bbd9-498e-9768-682fd5f17f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:10.030625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 658/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:10.076624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c92a4-4f6a-46f2-9155-919019c3d900 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:10.092159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c92a4-4f6a-46f2-9155-919019c3d900 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:10.098287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:10.098889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:10.099170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:10.099456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:10.109210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:10.110751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79fcd5-ad6b-43e7-a862-3762b4de04ba service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:10.121274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 659/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:12.341543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f933c-44e0-4b2e-9a90-a67a3afa38dc None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:12.342155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f933c-44e0-4b2e-9a90-a67a3afa38dc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:12.342155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f933c-44e0-4b2e-9a90-a67a3afa38dc None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:12.343819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 659/1318] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:12.354320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb87b8-c84a-491a-bbd2-2e9c92a00b08 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:12.354894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb87b8-c84a-491a-bbd2-2e9c92a00b08 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:12.355242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb87b8-c84a-491a-bbd2-2e9c92a00b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:12.381431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c5eb87b8-c84a-491a-bbd2-2e9c92a00b08 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:12.382658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c5eb87b8-c84a-491a-bbd2-2e9c92a00b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:12.392164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 660/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:12.439715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f933c-44e0-4b2e-9a90-a67a3afa38dc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:12.456477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f933c-44e0-4b2e-9a90-a67a3afa38dc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:12.463335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:12.463941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:12.464218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:12.464538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:12.474398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:12.476041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9081-448b-4beb-afc8-061e0d91c10d service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:12.487203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 660/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:23.460597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a422e0-3b7b-4521-bbe7-bfd68cbe6403 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:23.461306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a422e0-3b7b-4521-bbe7-bfd68cbe6403 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:23.461306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a422e0-3b7b-4521-bbe7-bfd68cbe6403 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:23.462862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 661/1321] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:23.469936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f075ee-8871-45c4-8007-bf5981710f5f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:23.470473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f075ee-8871-45c4-8007-bf5981710f5f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:23.470701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f075ee-8871-45c4-8007-bf5981710f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:23.494168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-38f075ee-8871-45c4-8007-bf5981710f5f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:23.495327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-38f075ee-8871-45c4-8007-bf5981710f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:23.503797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 661/1322] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:23.567544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a967a26-e814-467c-a618-7178d1aed630 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:23.567853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a967a26-e814-467c-a618-7178d1aed630 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:23.568118 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a967a26-e814-467c-a618-7178d1aed630 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:23.569850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 662/1323] 10.222.0.60 () {54 vars in 962 bytes} [Tue Nov 23 12:52:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:23.574647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38c8e-5028-433a-8b0a-6d3ad3250e42 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:23.574936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38c8e-5028-433a-8b0a-6d3ad3250e42 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:23.575212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38c8e-5028-433a-8b0a-6d3ad3250e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:23.644722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2fb38c8e-5028-433a-8b0a-6d3ad3250e42 None None] MFA Rules not processed for user `4f54266b73f542309722b317e80e5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:23.645998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2fb38c8e-5028-433a-8b0a-6d3ad3250e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:23.719884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 662/1324] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Nov 23 12:52:23 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:23.727800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a967a26-e814-467c-a618-7178d1aed630 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:23.740428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a967a26-e814-467c-a618-7178d1aed630 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:23.744775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:23.745373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:23.745651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:23.745922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:23.757202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:23.758629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c3c5c-c888-4b5d-b0e2-77129fcfad61 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:23.769965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 663/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:38.246284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b4939-adf3-4df2-a6b0-3e1c16051f57 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:38.247207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b4939-adf3-4df2-a6b0-3e1c16051f57 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:38.247207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b4939-adf3-4df2-a6b0-3e1c16051f57 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:38.249944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 663/1326] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:38.258589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a1fd-7579-48fe-a9de-425c4f2c6c4e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:38.259080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a1fd-7579-48fe-a9de-425c4f2c6c4e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:38.259080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a1fd-7579-48fe-a9de-425c4f2c6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:38.293730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d797a1fd-7579-48fe-a9de-425c4f2c6c4e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:38.294956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d797a1fd-7579-48fe-a9de-425c4f2c6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:38.304899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 664/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:38.365337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22632-dfd6-45ac-b02a-35badfabd22c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:38.365661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22632-dfd6-45ac-b02a-35badfabd22c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:38.365936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22632-dfd6-45ac-b02a-35badfabd22c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:38.367626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 664/1328] 10.222.0.60 () {54 vars in 956 bytes} [Tue Nov 23 12:52:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:38.373615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d35e3-b4aa-43e0-bc08-eb37fa5a6357 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:38.373891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d35e3-b4aa-43e0-bc08-eb37fa5a6357 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:38.374333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d35e3-b4aa-43e0-bc08-eb37fa5a6357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:38.460525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b97d35e3-b4aa-43e0-bc08-eb37fa5a6357 None None] MFA Rules not processed for user `6ba29c5b041e431ca8660c2d2ca8aee3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:38.461722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b97d35e3-b4aa-43e0-bc08-eb37fa5a6357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:38.539841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 665/1329] 10.222.0.60 () {58 vars in 1053 bytes} [Tue Nov 23 12:52:38 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:38.548983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22632-dfd6-45ac-b02a-35badfabd22c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:38.566692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22632-dfd6-45ac-b02a-35badfabd22c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:38.572847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:38.573641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:38.574031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:38.574323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:38.585979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:38.587394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcce15-3c1f-4511-ac7f-52770ab568fc service glance] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:38.596784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 665/1330] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:52:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:52:39.091814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f859eb-a518-4a5a-891d-86a843a5069f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:39.092122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f859eb-a518-4a5a-891d-86a843a5069f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:39.092436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f859eb-a518-4a5a-891d-86a843a5069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:39.169475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-54f859eb-a518-4a5a-891d-86a843a5069f None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:39.170664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-54f859eb-a518-4a5a-891d-86a843a5069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:39.249677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 666/1331] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:52:39 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:39.299424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46982c70-7958-468e-9152-a4badf846c06 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:39.299962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46982c70-7958-468e-9152-a4badf846c06 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:39.299962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46982c70-7958-468e-9152-a4badf846c06 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:39.301662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 666/1332] 10.222.0.60 () {54 vars in 942 bytes} [Tue Nov 23 12:52:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:39.308892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e5b9-6a8c-4364-8172-ab4a03a80c51 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:39.309372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e5b9-6a8c-4364-8172-ab4a03a80c51 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:39.309981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28e5b9-6a8c-4364-8172-ab4a03a80c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:39.383702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-af28e5b9-6a8c-4364-8172-ab4a03a80c51 None None] MFA Rules not processed for user `bb1451a2dbfe4b68a48d1dd9a31c09cf`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:39.384831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-af28e5b9-6a8c-4364-8172-ab4a03a80c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:39.484186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 667/1333] 10.222.0.60 () {58 vars in 1039 bytes} [Tue Nov 23 12:52:39 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:39.494860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46982c70-7958-468e-9152-a4badf846c06 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:39.511545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46982c70-7958-468e-9152-a4badf846c06 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:39.517319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:39.517892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:39.518180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:39.518459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:39.526833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:39.528474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1b06-5f6d-48ee-94f5-2937349a9b80 service swift] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:39.536408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 667/1334] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 12:52:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 12:52:56.441394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850e22-00d6-41db-abf5-959d1d8296ec None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:56.441956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850e22-00d6-41db-abf5-959d1d8296ec None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:56.442086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850e22-00d6-41db-abf5-959d1d8296ec None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:56.443757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 668/1335] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:56.449455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b4b07-f0a2-4509-bf5c-d00a1d7dc4c2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:56.449972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b4b07-f0a2-4509-bf5c-d00a1d7dc4c2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:56.450067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b4b07-f0a2-4509-bf5c-d00a1d7dc4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:56.472883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6e6b4b07-f0a2-4509-bf5c-d00a1d7dc4c2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:56.474193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6e6b4b07-f0a2-4509-bf5c-d00a1d7dc4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:56.481660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 668/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:56.507061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850e22-00d6-41db-abf5-959d1d8296ec None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:56.520510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850e22-00d6-41db-abf5-959d1d8296ec None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:56.525119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:56.525732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:56.526103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:56.526416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:56.527139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:56.529186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece84c47-5ec1-49ac-9b7e-e9cfbfc00732 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:56.545172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 669/1337] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:52:56 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:52:58.685870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bc1-8ba3-4654-a891-2faa8495eb5a None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:58.688315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bc1-8ba3-4654-a891-2faa8495eb5a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:58.688315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf94bc1-8ba3-4654-a891-2faa8495eb5a None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:58.689053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 669/1338] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:52:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:52:58.694664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:58.695213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:58.695378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:58.719504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:52:58.721023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:52:58.728941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 670/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:52:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:52:58.754238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94bc1-8ba3-4654-a891-2faa8495eb5a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:58.767959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf94bc1-8ba3-4654-a891-2faa8495eb5a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:58.775057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:58.776170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:58.776474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:58.776775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] PATH_INFO: `/v3/projects/324369dc1750429882979e844308778e` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:58.790877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] RBAC: Authorizing `identity:get_project(project_id=324369dc1750429882979e844308778e)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:58.793405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:58.795388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 670/1340] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:52:58 2021] GET /identity/v3/projects/324369dc1750429882979e844308778e => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:52:58.802629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:58.812706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8603b-4e46-41eb-82b4-bacd5d345322 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:58.818542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:58.819174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:58.819462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:58.819741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:58.820526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] RBAC: Adding query filter params (scope.project.id=324369dc1750429882979e844308778e) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:52:58.820818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:58.822835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641cdf1-b0c3-4078-9ac4-e60833fe58a5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:58.830096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 671/1341] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:52:58 2021] GET /identity/v3/role_assignments?scope.project.id=324369dc1750429882979e844308778e => generated 526 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:52:58.836694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:52:58.847670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3586-8d02-411e-97ba-0c8e3c1cf532 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:52:58.853336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:52:58.854239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:52:58.854527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:52:58.854794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] PATH_INFO: `/v3/users/df96507db6294aaf8a383f26375ab060` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:52:58.878519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] RBAC: Authorizing `identity:get_user(user_id=df96507db6294aaf8a383f26375ab060)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:52:58.880719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7ea90-5ba4-49a4-b48b-ddd712cbab20 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:52:58.882382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 671/1342] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:52:58 2021] GET /identity/v3/users/df96507db6294aaf8a383f26375ab060 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:01.072669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be884e9-2560-4933-a3b8-278b51a961ae None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:01.073250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be884e9-2560-4933-a3b8-278b51a961ae None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:01.073250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be884e9-2560-4933-a3b8-278b51a961ae None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:01.074978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 672/1343] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:01.081275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:01.081743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:01.081833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:01.105931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:01.107095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:01.115730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 672/1344] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:01.138659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be884e9-2560-4933-a3b8-278b51a961ae None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:01.152648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be884e9-2560-4933-a3b8-278b51a961ae None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:01.157186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:01.157982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:01.158261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:01.158541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] PATH_INFO: `/v3/projects/513b5f1fb02e49ddb96b02dda9266275` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:01.171185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=513b5f1fb02e49ddb96b02dda9266275)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:01.173421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:01.175121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 673/1345] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:01 2021] GET /identity/v3/projects/513b5f1fb02e49ddb96b02dda9266275 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:01.181677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:01.191617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9e5f-a10e-48b6-8993-547b15d95c29 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:01.196825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:01.197411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:01.197694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:01.197971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:01.198713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] RBAC: Adding query filter params (scope.project.id=513b5f1fb02e49ddb96b02dda9266275) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:01.199012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:01.200925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fb61-c764-42df-8724-c9937d161d1a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:01.207678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 673/1346] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:01 2021] GET /identity/v3/role_assignments?scope.project.id=513b5f1fb02e49ddb96b02dda9266275 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:01.214040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:01.224415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ff564-94f9-4278-9975-34fa1e3588c2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:01.229284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:01.230092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:01.230380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:01.230660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:01.252044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:01.254253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e7e1-d028-4101-959e-24292e552d0f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:01.256272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 674/1347] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:01 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:03.421087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866352c-5511-4d26-9790-8ff160433926 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.421646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866352c-5511-4d26-9790-8ff160433926 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.421646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866352c-5511-4d26-9790-8ff160433926 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.423435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 674/1348] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:03.429383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.429899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.429991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.455157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:03.456645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:03.465230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 675/1349] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:03.490176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866352c-5511-4d26-9790-8ff160433926 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:03.504095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866352c-5511-4d26-9790-8ff160433926 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:03.509081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:03.509897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.510183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.510463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] PATH_INFO: `/v3/projects/724025c1e3724b58b72260918cc31b70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.525233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] RBAC: Authorizing `identity:get_project(project_id=724025c1e3724b58b72260918cc31b70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:03.527391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:03.529375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 675/1350] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:03 2021] GET /identity/v3/projects/724025c1e3724b58b72260918cc31b70 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:03.536118 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:03.546176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3a9db-a719-4343-a57e-69e35a562fe6 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:03.552584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:03.553232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.553711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.554012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.554761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] RBAC: Adding query filter params (scope.project.id=724025c1e3724b58b72260918cc31b70) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:03.555049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:03.557019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:03.565468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 676/1351] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:03 2021] GET /identity/v3/role_assignments?scope.project.id=724025c1e3724b58b72260918cc31b70 => generated 1934 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:53:03.572124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:03.582490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2ce0e-63e6-4c82-8060-ce02c5fabb6a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:03.587099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:03.587970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.588404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.588732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] PATH_INFO: `/v3/users/4b441378e641415e97cd2c14dde4afda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.589963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] RBAC: Authorizing `identity:get_user(user_id=4b441378e641415e97cd2c14dde4afda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:03.592264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1987-5946-4b27-8b86-1355c591145d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:03.593922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 676/1352] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:03 2021] GET /identity/v3/users/4b441378e641415e97cd2c14dde4afda => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:03.600217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:03.611014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fec62-d519-433d-aaf7-b60042e57bf6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:03.616584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:03.617413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:03.617698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:03.617979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:03.619249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:03.621142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba4fd8-e2cb-4ae4-9194-62102946a503 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:03.622741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 677/1353] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:03 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:05.837519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d01-0702-4702-ad6d-f7db7c16979a None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:05.838127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d01-0702-4702-ad6d-f7db7c16979a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:05.838127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207d01-0702-4702-ad6d-f7db7c16979a None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:05.839773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 677/1354] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:05.845916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:05.846355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:05.846467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:05.870818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:05.872495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:05.885313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 678/1355] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:05.911678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207d01-0702-4702-ad6d-f7db7c16979a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:05.924470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207d01-0702-4702-ad6d-f7db7c16979a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:05.928955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:05.929738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:05.930019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:05.930324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] PATH_INFO: `/v3/projects/8435b06995c74b12b85f68f511006924` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:05.942651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] RBAC: Authorizing `identity:get_project(project_id=8435b06995c74b12b85f68f511006924)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:05.944787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:05.946392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 678/1356] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:05 2021] GET /identity/v3/projects/8435b06995c74b12b85f68f511006924 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:05.955796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:05.969593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9488975-c91d-4477-af59-93c81b21d9d4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:05.976824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:05.977657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:05.977959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:05.978340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:05.979393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] RBAC: Adding query filter params (scope.project.id=8435b06995c74b12b85f68f511006924) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:05.979821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:05.981990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:05.990334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 679/1357] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:05 2021] GET /identity/v3/role_assignments?scope.project.id=8435b06995c74b12b85f68f511006924 => generated 1934 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:53:05.996453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:06.006918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2616e-6ece-4531-a93f-d1a1831e4425 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:06.012094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:06.012909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:06.013190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:06.013452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] PATH_INFO: `/v3/users/ac27d91e503144fb8fc7ac194392b17d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:06.034050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] RBAC: Authorizing `identity:get_user(user_id=ac27d91e503144fb8fc7ac194392b17d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:06.036221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4636c2-6669-48cc-9ab7-4860d1cfac3b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:06.037880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 679/1358] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:05 2021] GET /identity/v3/users/ac27d91e503144fb8fc7ac194392b17d => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:06.043977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:06.054087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629daf1-3240-4253-9a7a-ded87b4581a1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:06.059401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:06.060225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:06.060540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:06.060822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:06.061996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:06.063834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442635-f525-4ce4-96a0-8d13cebe3bba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:06.065390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 680/1359] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:06 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:08.263215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3081-f668-4d9b-b1bf-2129f5bc804b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:08.263820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3081-f668-4d9b-b1bf-2129f5bc804b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:08.263820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3081-f668-4d9b-b1bf-2129f5bc804b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:08.265972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 680/1360] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:08.271902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:08.272406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:08.272496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:08.304226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:08.305464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:08.314223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 681/1361] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:08.352733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec3081-f668-4d9b-b1bf-2129f5bc804b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:08.365699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec3081-f668-4d9b-b1bf-2129f5bc804b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:08.372880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:08.373685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:08.373964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:08.374241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] PATH_INFO: `/v3/projects/965aa47964184ec5b055bf508a421f8b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:08.388188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] RBAC: Authorizing `identity:get_project(project_id=965aa47964184ec5b055bf508a421f8b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:08.390665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:08.392633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 681/1362] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:08 2021] GET /identity/v3/projects/965aa47964184ec5b055bf508a421f8b => generated 361 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:08.399741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:08.409874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bfba6-9a39-48c5-9c58-30dd157dc1d9 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:08.415937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:08.416677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:08.417036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:08.417437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:08.418171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] RBAC: Adding query filter params (scope.project.id=965aa47964184ec5b055bf508a421f8b) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:08.418495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:08.420401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99d725-e576-4933-9d88-4598b219b7e5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:08.427443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 682/1363] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:08 2021] GET /identity/v3/role_assignments?scope.project.id=965aa47964184ec5b055bf508a421f8b => generated 526 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:08.433915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:08.444719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967051b9-7381-491b-a2f7-60b2de2c833c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:08.450319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:08.451133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:08.451427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:08.451708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] PATH_INFO: `/v3/users/3aad461a597344d2bf750cedb0d7d90b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:08.473720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3aad461a597344d2bf750cedb0d7d90b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:08.475903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354d1e9-4ba2-4be0-bb67-bdb9bdd1dee0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:08.477632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 682/1364] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:08 2021] GET /identity/v3/users/3aad461a597344d2bf750cedb0d7d90b => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:10.680524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7dd45-e142-4f2c-8a53-e90579b3f75f None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.681158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7dd45-e142-4f2c-8a53-e90579b3f75f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.681158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7dd45-e142-4f2c-8a53-e90579b3f75f None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.683678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 683/1365] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:10.691079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.691563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.691680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.718866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:10.720135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:10.727750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 683/1366] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:53:10.751571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7dd45-e142-4f2c-8a53-e90579b3f75f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:10.765638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7dd45-e142-4f2c-8a53-e90579b3f75f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:10.770362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:10.771207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.771493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.771776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] PATH_INFO: `/v3/projects/bfacf529bd0e454891b501b5d20c5acc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.784633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] RBAC: Authorizing `identity:get_project(project_id=bfacf529bd0e454891b501b5d20c5acc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:10.786748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:10.788408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 684/1367] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:10 2021] GET /identity/v3/projects/bfacf529bd0e454891b501b5d20c5acc => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:10.795377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:10.804811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73fd1a-7b7d-474f-b767-b89f81667a51 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:10.809908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:10.810557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.810729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.811009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.811739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] RBAC: Adding query filter params (scope.project.id=bfacf529bd0e454891b501b5d20c5acc) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:10.812046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:10.814012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:10.820157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 684/1368] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:10 2021] GET /identity/v3/role_assignments?scope.project.id=bfacf529bd0e454891b501b5d20c5acc => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:10.826332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:10.837269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61de81-6e4d-4b89-9556-526b7fe3d282 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:10.842888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:10.843700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.843983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.844281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] PATH_INFO: `/v3/users/b26bcd3e692e4009a33664fe5573fc1f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.866530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] RBAC: Authorizing `identity:get_user(user_id=b26bcd3e692e4009a33664fe5573fc1f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:10.868829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490038c-3910-49a8-b003-18ab1d360331 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:10.870443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 685/1369] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:10 2021] GET /identity/v3/users/b26bcd3e692e4009a33664fe5573fc1f => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:10.877028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:10.887304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1a128-ebad-4de1-ba7f-e8e1e5087800 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:10.892596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:10.893384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:10.893668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:10.893953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] PATH_INFO: `/v3/users/6f94bb759db9468890c62cebbf2f42ec` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:10.913112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f94bb759db9468890c62cebbf2f42ec)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:10.915280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ed0fd-bcf5-4b94-b8a8-7011c622e746 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:10.916864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 685/1370] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:10 2021] GET /identity/v3/users/6f94bb759db9468890c62cebbf2f42ec => generated 285 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:53:13.151646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80202ae-2076-4370-8220-5b1c2f566cb2 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:13.152206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80202ae-2076-4370-8220-5b1c2f566cb2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:13.152206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80202ae-2076-4370-8220-5b1c2f566cb2 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:13.153796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 686/1371] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:53:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:13.159788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:13.160422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:13.160539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:13.189815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:13.190999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:13.198823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 686/1372] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:53:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:13.224505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80202ae-2076-4370-8220-5b1c2f566cb2 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:13.239385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80202ae-2076-4370-8220-5b1c2f566cb2 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:13.243808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:13.244619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:13.244902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:13.245180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] PATH_INFO: `/v3/projects/c8d73aaed4704c2faee627a52d37a0f8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:13.246329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8d73aaed4704c2faee627a52d37a0f8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:13.248136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:13.249817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 687/1373] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Nov 23 12:53:13 2021] GET /identity/v3/projects/c8d73aaed4704c2faee627a52d37a0f8 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:13.256756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:13.268114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d5d6f-34f7-4e65-9ced-7b50293c5601 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:13.273193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:13.273798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:13.274083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:13.274336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:13.275110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] RBAC: Adding query filter params (scope.project.id=c8d73aaed4704c2faee627a52d37a0f8) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:53:13.275406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:13.277297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc003514-3459-48d6-b838-d5f782ec19a9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:13.284117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 687/1374] 10.222.0.60 () {56 vars in 1231 bytes} [Tue Nov 23 12:53:13 2021] GET /identity/v3/role_assignments?scope.project.id=c8d73aaed4704c2faee627a52d37a0f8 => generated 879 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:13.290530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:13.301327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8c5bf-8332-4a1d-9ff5-d9258b2b37f9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:13.306946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:13.307782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:13.308061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:13.308382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] PATH_INFO: `/v3/users/3fde6f358f0c4f9d97186836d44cc1d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:13.309623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fde6f358f0c4f9d97186836d44cc1d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:13.311436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf7372-cf1b-482e-843c-b85684e9cb48 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:13.312989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 688/1375] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Nov 23 12:53:13 2021] GET /identity/v3/users/3fde6f358f0c4f9d97186836d44cc1d3 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:53:18.703054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c2f2f-7ce5-40d4-9ced-9b599a895dbc None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:18.703620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c2f2f-7ce5-40d4-9ced-9b599a895dbc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:18.703620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c2f2f-7ce5-40d4-9ced-9b599a895dbc None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:18.705458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 688/1376] 10.222.0.60 () {54 vars in 918 bytes} [Tue Nov 23 12:53:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:18.711687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fc0d-a683-4d02-bfc8-65ec3eb2d57f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:18.712144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fc0d-a683-4d02-bfc8-65ec3eb2d57f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:18.712283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fc0d-a683-4d02-bfc8-65ec3eb2d57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:18.736066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e276fc0d-a683-4d02-bfc8-65ec3eb2d57f None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:18.737374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e276fc0d-a683-4d02-bfc8-65ec3eb2d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:18.748284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 689/1377] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Nov 23 12:53:18 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:18.764551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8a17-5e69-4cfc-b30b-33276ddd8a96 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:18.764853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8a17-5e69-4cfc-b30b-33276ddd8a96 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:18.765576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8a17-5e69-4cfc-b30b-33276ddd8a96 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:18.767850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 689/1378] 10.222.0.60 () {54 vars in 918 bytes} [Tue Nov 23 12:53:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:18.773039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f63f1-080f-4020-ba29-0a7a6e986c96 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:18.773330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f63f1-080f-4020-ba29-0a7a6e986c96 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:18.773609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f63f1-080f-4020-ba29-0a7a6e986c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:18.796537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-017f63f1-080f-4020-ba29-0a7a6e986c96 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:18.797707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-017f63f1-080f-4020-ba29-0a7a6e986c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:18.806765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 690/1379] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Nov 23 12:53:18 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:21.339737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441cb6-78d7-4f32-aba9-221f6fb8315c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:21.340634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441cb6-78d7-4f32-aba9-221f6fb8315c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:21.340634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441cb6-78d7-4f32-aba9-221f6fb8315c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:21.343109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:21.350428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8773f5-de68-4c86-86b8-11b3f0426f88 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:21.350918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8773f5-de68-4c86-86b8-11b3f0426f88 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:21.351014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8773f5-de68-4c86-86b8-11b3f0426f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:21.383784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-db8773f5-de68-4c86-86b8-11b3f0426f88 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:21.384961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-db8773f5-de68-4c86-86b8-11b3f0426f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:21.394900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:21.438928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441cb6-78d7-4f32-aba9-221f6fb8315c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:21.454976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441cb6-78d7-4f32-aba9-221f6fb8315c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:21.460805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:21.461382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:21.461671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:21.461952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:21.471090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:21.472713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f3cd-ff17-42ed-9b00-326d7e33f62f service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:21.483359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 691/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:22.870912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9471e-d99e-4d87-9072-05644756b33a None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:22.871504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9471e-d99e-4d87-9072-05644756b33a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:22.871504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9471e-d99e-4d87-9072-05644756b33a None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:22.873358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:22.879003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6083f-5656-41b5-a39d-7f5bad02dd62 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:22.879532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6083f-5656-41b5-a39d-7f5bad02dd62 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:22.879532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6083f-5656-41b5-a39d-7f5bad02dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:22.908105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-70f6083f-5656-41b5-a39d-7f5bad02dd62 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:22.909461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-70f6083f-5656-41b5-a39d-7f5bad02dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:22.917830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:23.071447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9471e-d99e-4d87-9072-05644756b33a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:23.089308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9471e-d99e-4d87-9072-05644756b33a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:23.094906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:23.095505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:23.095790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:23.096065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:23.104227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:23.105889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8f6d-8308-401a-b2a9-71863818948d service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:23.114972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 693/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:24.548492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d8c10-c09c-4edb-be7d-e09efc0b7d65 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:24.549239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d8c10-c09c-4edb-be7d-e09efc0b7d65 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:24.549239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d8c10-c09c-4edb-be7d-e09efc0b7d65 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:24.550914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:24.557125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447768-6491-40a7-b243-0f614843dfad None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:24.557698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447768-6491-40a7-b243-0f614843dfad None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:24.557698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b447768-6491-40a7-b243-0f614843dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:24.582627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8b447768-6491-40a7-b243-0f614843dfad None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:24.583807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8b447768-6491-40a7-b243-0f614843dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:24.592719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:24.742818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d8c10-c09c-4edb-be7d-e09efc0b7d65 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:24.766763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d8c10-c09c-4edb-be7d-e09efc0b7d65 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:24.774237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:24.775029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:24.775350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:24.775660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:24.788136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:24.790509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de897-08c2-47bb-975a-deb64fdb98e7 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:24.800517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 694/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:26.205754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4b05-339b-4215-b984-949ae3409b38 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:26.206325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4b05-339b-4215-b984-949ae3409b38 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:26.206325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4b05-339b-4215-b984-949ae3409b38 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:26.209610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:26.218162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cdfc-8c9e-4603-9540-38d7811f341b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:26.218826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cdfc-8c9e-4603-9540-38d7811f341b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:26.218979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cdfc-8c9e-4603-9540-38d7811f341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:26.249792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cd84cdfc-8c9e-4603-9540-38d7811f341b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:26.250963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cd84cdfc-8c9e-4603-9540-38d7811f341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:26.259735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:26.410456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e4b05-339b-4215-b984-949ae3409b38 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:26.425400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e4b05-339b-4215-b984-949ae3409b38 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:26.431218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:26.431791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:26.432073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:26.432397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:26.443014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:26.444729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f83b-7049-4981-b5af-36ce49710b5e service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:26.454328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 696/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:27.861216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca8c1-b515-415a-9fd9-40d150eb82f4 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:27.861850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca8c1-b515-415a-9fd9-40d150eb82f4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:27.861850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca8c1-b515-415a-9fd9-40d150eb82f4 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:27.863830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:27.872178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400a7a-3c76-4bf1-99fa-6dcab5a31ad2 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:27.872831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400a7a-3c76-4bf1-99fa-6dcab5a31ad2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:27.872831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400a7a-3c76-4bf1-99fa-6dcab5a31ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:27.898029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-91400a7a-3c76-4bf1-99fa-6dcab5a31ad2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:27.899244 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-91400a7a-3c76-4bf1-99fa-6dcab5a31ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:27.907174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:28.057159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca8c1-b515-415a-9fd9-40d150eb82f4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:28.072259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca8c1-b515-415a-9fd9-40d150eb82f4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:28.077874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:28.078421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:28.078718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:28.079020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:28.088461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:28.090053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b2e0d-ad37-4f0c-a4fd-be5eff4ff79a service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:28.100625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 697/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:29.445625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebbcb6-4bbe-4036-b05d-5f90a6f1e77b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:29.446221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebbcb6-4bbe-4036-b05d-5f90a6f1e77b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:29.446221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebbcb6-4bbe-4036-b05d-5f90a6f1e77b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:29.448735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:29.454976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cf86-c4a3-4170-bf87-230984fed760 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:29.455716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cf86-c4a3-4170-bf87-230984fed760 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:29.456130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1cf86-c4a3-4170-bf87-230984fed760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:29.486969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6ab1cf86-c4a3-4170-bf87-230984fed760 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:29.488136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6ab1cf86-c4a3-4170-bf87-230984fed760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:29.498434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:29.661291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebbcb6-4bbe-4036-b05d-5f90a6f1e77b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:29.677078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebbcb6-4bbe-4036-b05d-5f90a6f1e77b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:29.682996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:29.683575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:29.683857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:29.684181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:29.693449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:29.695031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10924-7f1f-4aab-8d44-744d586137eb service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:29.704721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 699/1397] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:53:31.021461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa37-4955-4dbe-9a48-f1d4021d85c2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:31.022352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa37-4955-4dbe-9a48-f1d4021d85c2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:31.022352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa37-4955-4dbe-9a48-f1d4021d85c2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:31.025459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:31.033474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262ec3f-12e0-4025-88db-deae6d653071 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:31.034113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262ec3f-12e0-4025-88db-deae6d653071 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:31.034113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262ec3f-12e0-4025-88db-deae6d653071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:31.062433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7262ec3f-12e0-4025-88db-deae6d653071 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:31.063718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7262ec3f-12e0-4025-88db-deae6d653071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:31.073092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:31.224947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42efa37-4955-4dbe-9a48-f1d4021d85c2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:31.240600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42efa37-4955-4dbe-9a48-f1d4021d85c2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:31.247331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:31.247901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:31.248176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:31.248481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:31.257922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:31.259496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdb41-36d7-4570-bc97-8c486c4b2f00 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:31.269915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 700/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:32.598868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e1da-3a0f-46f4-a59f-e93c600f2b51 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:32.599517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e1da-3a0f-46f4-a59f-e93c600f2b51 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:32.599517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e1da-3a0f-46f4-a59f-e93c600f2b51 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:32.601320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:32.607620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7883-6a56-4970-b5cc-70dee75e043f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:32.608347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7883-6a56-4970-b5cc-70dee75e043f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:32.608347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7883-6a56-4970-b5cc-70dee75e043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:32.633897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b4ff7883-6a56-4970-b5cc-70dee75e043f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:32.635106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b4ff7883-6a56-4970-b5cc-70dee75e043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:32.645276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:32.797078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37e1da-3a0f-46f4-a59f-e93c600f2b51 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:32.812588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37e1da-3a0f-46f4-a59f-e93c600f2b51 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:32.818573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:32.819167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:32.819451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:32.819735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:32.828217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:32.829949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c7bd-95fc-4309-a76a-6e4f5742a0c6 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:32.839166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 702/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:34.178637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e5e6-a4c7-4c4b-aa97-c50858bbfd56 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:34.179184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e5e6-a4c7-4c4b-aa97-c50858bbfd56 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:34.179184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e5e6-a4c7-4c4b-aa97-c50858bbfd56 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:34.180875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:53:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:34.187164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bedab-6971-4b79-a620-5f4121306d34 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:34.187619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bedab-6971-4b79-a620-5f4121306d34 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:34.187725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bedab-6971-4b79-a620-5f4121306d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:34.212207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d07bedab-6971-4b79-a620-5f4121306d34 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:34.213434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d07bedab-6971-4b79-a620-5f4121306d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:34.222140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:53:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:34.372617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e5e6-a4c7-4c4b-aa97-c50858bbfd56 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:34.387169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e5e6-a4c7-4c4b-aa97-c50858bbfd56 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:34.393653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:34.394210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:34.394485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:34.394760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:34.403701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:34.405309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42a20-b4c5-4cf5-965e-643adf2e3271 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:34.415022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 703/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:36.453297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc781f-e0b7-44a5-9e42-9df6dd7b88e3 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:36.453868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc781f-e0b7-44a5-9e42-9df6dd7b88e3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:36.453868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc781f-e0b7-44a5-9e42-9df6dd7b88e3 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:36.455625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:36.461402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb914-1f60-49fd-815a-0609e503f53c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:36.461881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb914-1f60-49fd-815a-0609e503f53c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:36.461976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eb914-1f60-49fd-815a-0609e503f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:36.485669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b13eb914-1f60-49fd-815a-0609e503f53c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:36.486814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b13eb914-1f60-49fd-815a-0609e503f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:36.495466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:36.538774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc781f-e0b7-44a5-9e42-9df6dd7b88e3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:36.554511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc781f-e0b7-44a5-9e42-9df6dd7b88e3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:36.558706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:36.559297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:36.559582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:36.559859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:36.569286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:36.570737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a25f8-b2e2-4b0d-a012-03ca51eb3ec8 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:36.580213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 705/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:38.861768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16786-75e2-4a51-89cd-22d6e885f03d None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:38.862356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16786-75e2-4a51-89cd-22d6e885f03d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:38.862356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16786-75e2-4a51-89cd-22d6e885f03d None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:38.864360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:38.869761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba627a-a5ca-43b8-8afd-4f1d9260714a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:38.870206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba627a-a5ca-43b8-8afd-4f1d9260714a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:38.870319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba627a-a5ca-43b8-8afd-4f1d9260714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:38.896834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ccba627a-a5ca-43b8-8afd-4f1d9260714a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:38.898011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ccba627a-a5ca-43b8-8afd-4f1d9260714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:38.905589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:38.945260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e16786-75e2-4a51-89cd-22d6e885f03d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:38.958844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e16786-75e2-4a51-89cd-22d6e885f03d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:38.962749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:38.963357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:38.963632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:38.963903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:38.975194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:38.976641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92b55-35e8-4cc0-b73f-4463416bd289 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:38.986767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 706/1412] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:41.547928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570374-d4f4-4c74-b8ff-9e4bf79f196c None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:41.548646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570374-d4f4-4c74-b8ff-9e4bf79f196c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:41.548646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92570374-d4f4-4c74-b8ff-9e4bf79f196c None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:41.550462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:41.556198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071d67-37dd-47b1-a66c-fad0224bfeb7 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:41.556689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071d67-37dd-47b1-a66c-fad0224bfeb7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:41.556789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2071d67-37dd-47b1-a66c-fad0224bfeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:41.581014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a2071d67-37dd-47b1-a66c-fad0224bfeb7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:41.582170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a2071d67-37dd-47b1-a66c-fad0224bfeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:41.590642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:41.631896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92570374-d4f4-4c74-b8ff-9e4bf79f196c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:41.650543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92570374-d4f4-4c74-b8ff-9e4bf79f196c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:41.655808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:41.656431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:41.656721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:41.656996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:41.666701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:41.668188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c182-80a0-44b6-a6e8-7ed60cc137ba service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:41.677820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 708/1415] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:53:43.880208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e6c0-55e4-4939-bc81-5241f48786df None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:43.881062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e6c0-55e4-4939-bc81-5241f48786df None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:43.881062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e6c0-55e4-4939-bc81-5241f48786df None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:43.883843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:43.892327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab132b-5bd7-4007-8aec-cb11b4dca3da None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:43.892933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab132b-5bd7-4007-8aec-cb11b4dca3da None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:43.892933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab132b-5bd7-4007-8aec-cb11b4dca3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:43.915937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-47ab132b-5bd7-4007-8aec-cb11b4dca3da None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:43.917109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-47ab132b-5bd7-4007-8aec-cb11b4dca3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:43.925025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:53:43.964707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7e6c0-55e4-4939-bc81-5241f48786df None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:43.977260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7e6c0-55e4-4939-bc81-5241f48786df None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:43.982057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:43.982637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:43.982936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:43.983205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:43.993350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:43.994775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bd171-3d33-4d32-852d-37475792f62d service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:44.004616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 709/1418] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:46.220924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cca7-a32b-47a4-b0d0-f37990635a3d None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:46.221512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cca7-a32b-47a4-b0d0-f37990635a3d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:46.221512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cca7-a32b-47a4-b0d0-f37990635a3d None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:46.223116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:46.229402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bc4f-c820-4759-b46f-717abb293fb3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:46.229866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bc4f-c820-4759-b46f-717abb293fb3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:46.230010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597bc4f-c820-4759-b46f-717abb293fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:46.255940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9597bc4f-c820-4759-b46f-717abb293fb3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:46.257163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9597bc4f-c820-4759-b46f-717abb293fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:46.266294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:46.305462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cca7-a32b-47a4-b0d0-f37990635a3d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:46.318322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cca7-a32b-47a4-b0d0-f37990635a3d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:46.324057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:46.324892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:46.325246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:46.325633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:46.336472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:46.337918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0a04-cdd2-4534-a383-abf29e9a99f9 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:46.347230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 711/1421] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:48.571530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788349-fd4f-4268-819b-765693bd666c None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:48.572159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788349-fd4f-4268-819b-765693bd666c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:48.572159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af788349-fd4f-4268-819b-765693bd666c None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:48.573809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:48.580600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6740-f028-4386-bce7-41d214ba0215 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:48.581059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6740-f028-4386-bce7-41d214ba0215 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:48.581174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6740-f028-4386-bce7-41d214ba0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:48.614101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-132e6740-f028-4386-bce7-41d214ba0215 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:48.615280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-132e6740-f028-4386-bce7-41d214ba0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:48.623312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:48.673202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788349-fd4f-4268-819b-765693bd666c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:48.687597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af788349-fd4f-4268-819b-765693bd666c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:48.694255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:48.695102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:48.695388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:48.695732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:48.708629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:48.710066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666919e2-1cbd-4f99-8f69-38aef4ceabdb service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:48.719285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 712/1424] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:50.950668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cee6-7e02-4417-acd5-8980ddef2797 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:50.951294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cee6-7e02-4417-acd5-8980ddef2797 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:50.951294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cee6-7e02-4417-acd5-8980ddef2797 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:50.952965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:50.959561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b429d-6c48-45c1-988a-7ff393567daa None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:50.960087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b429d-6c48-45c1-988a-7ff393567daa None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:50.960087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b429d-6c48-45c1-988a-7ff393567daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:50.983085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2c5b429d-6c48-45c1-988a-7ff393567daa None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:50.984276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2c5b429d-6c48-45c1-988a-7ff393567daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:50.993684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:51.036613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3cee6-7e02-4417-acd5-8980ddef2797 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:51.049246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3cee6-7e02-4417-acd5-8980ddef2797 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:51.052782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:51.053349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:51.053627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:51.053903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:51.063619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:51.065167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164811-7027-4993-b5d9-c90ac2e82240 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:51.075546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 714/1427] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:53:53.225587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce932-a41e-4a85-be07-5b67b2a7bf99 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:53.226192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce932-a41e-4a85-be07-5b67b2a7bf99 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:53.226192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ce932-a41e-4a85-be07-5b67b2a7bf99 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:53.227744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:53.233322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f44f9-ffa6-40e1-aafc-e46afa2a5e70 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:53.233807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f44f9-ffa6-40e1-aafc-e46afa2a5e70 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:53.233905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f44f9-ffa6-40e1-aafc-e46afa2a5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:53.258081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f49f44f9-ffa6-40e1-aafc-e46afa2a5e70 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:53.259252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f49f44f9-ffa6-40e1-aafc-e46afa2a5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:53.267995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:53.309980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ce932-a41e-4a85-be07-5b67b2a7bf99 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:53.325818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ce932-a41e-4a85-be07-5b67b2a7bf99 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:53.330232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:53.330778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:53.331064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:53.331353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:53.341159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:53.342599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565fc9-4943-41b4-a8b4-c89925a91e38 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:53.352520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 715/1430] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:55.539239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556497b-a6bc-4ebd-b277-e77d9444d73b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:55.539886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556497b-a6bc-4ebd-b277-e77d9444d73b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:55.539886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556497b-a6bc-4ebd-b277-e77d9444d73b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:55.541521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:55.547260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a3bce-c644-4e35-b441-fb9b7eda4566 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:55.547768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a3bce-c644-4e35-b441-fb9b7eda4566 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:55.547895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a3bce-c644-4e35-b441-fb9b7eda4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:55.571992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-139a3bce-c644-4e35-b441-fb9b7eda4566 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:55.573180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-139a3bce-c644-4e35-b441-fb9b7eda4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:55.584094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:55.622274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556497b-a6bc-4ebd-b277-e77d9444d73b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:55.634966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556497b-a6bc-4ebd-b277-e77d9444d73b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:55.640178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:55.640805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:55.641089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:55.641365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:55.652522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:55.653993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ee5a-6006-4ad9-8d0e-a2703ebdcdd0 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:55.663589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 717/1433] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:57.852496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51dfc4-24bb-45d9-81b5-5acd2bc27c9b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:57.853122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51dfc4-24bb-45d9-81b5-5acd2bc27c9b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:57.853122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51dfc4-24bb-45d9-81b5-5acd2bc27c9b None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:57.854753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:53:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:53:57.861300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed178e-af81-467d-b944-be8bdf4cb0ce None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:57.861830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed178e-af81-467d-b944-be8bdf4cb0ce None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:57.861925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed178e-af81-467d-b944-be8bdf4cb0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:57.891901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-38ed178e-af81-467d-b944-be8bdf4cb0ce None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:53:57.893136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38ed178e-af81-467d-b944-be8bdf4cb0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:53:57.900976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:53:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:53:57.940998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51dfc4-24bb-45d9-81b5-5acd2bc27c9b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:53:57.952630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51dfc4-24bb-45d9-81b5-5acd2bc27c9b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:53:57.956843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:53:57.957407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:53:57.957694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:53:57.957971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:53:57.967148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:53:57.968635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51dddf-e957-4f0e-9f39-47ea88568575 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:53:57.977677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 718/1436] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:53:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:54:15.615836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696daef-7962-41bf-ac43-9039ad91a0fe None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:15.616763 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696daef-7962-41bf-ac43-9039ad91a0fe None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:15.616763 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696daef-7962-41bf-ac43-9039ad91a0fe None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:15.618135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 719/1437] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:15.624918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae127171-af61-4222-8147-c0e20db4009b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:15.626388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae127171-af61-4222-8147-c0e20db4009b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:15.626388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae127171-af61-4222-8147-c0e20db4009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:15.655709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ae127171-af61-4222-8147-c0e20db4009b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:15.657180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ae127171-af61-4222-8147-c0e20db4009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:15.666430 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 719/1438] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:15.716873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a28da-a6cb-416e-8b8d-72545011ca1a None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:15.717171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a28da-a6cb-416e-8b8d-72545011ca1a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:15.717449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a28da-a6cb-416e-8b8d-72545011ca1a None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:15.719149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 720/1439] 10.222.0.60 () {54 vars in 956 bytes} [Tue Nov 23 12:54:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:15.725147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb716f-29b7-4b8a-8b70-a074f0cfb7fd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:15.725446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb716f-29b7-4b8a-8b70-a074f0cfb7fd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:15.725739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb716f-29b7-4b8a-8b70-a074f0cfb7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:15.755038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-0eeb716f-29b7-4b8a-8b70-a074f0cfb7fd None None] MFA Rules not processed for user `6ba29c5b041e431ca8660c2d2ca8aee3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:15.756542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0eeb716f-29b7-4b8a-8b70-a074f0cfb7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:15.762950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 720/1440] 10.222.0.60 () {58 vars in 1053 bytes} [Tue Nov 23 12:54:15 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:54:15.771248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a28da-a6cb-416e-8b8d-72545011ca1a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:15.782293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a28da-a6cb-416e-8b8d-72545011ca1a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:15.785809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:15.786399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:15.786676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:15.786953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:15.796429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:15.797978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407468b9-4431-40d3-bdcf-fd4b97b1c33b service glance] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:15.807440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 721/1441] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:54:18.177852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e60af-a718-47c5-9e54-74bfcc378bce None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:18.178456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e60af-a718-47c5-9e54-74bfcc378bce None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:18.178456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e60af-a718-47c5-9e54-74bfcc378bce None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:18.180261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 721/1442] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:18.187043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc884b-f214-41e7-9d1e-14951430e4f7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:18.187604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc884b-f214-41e7-9d1e-14951430e4f7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:18.187604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc884b-f214-41e7-9d1e-14951430e4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:18.216970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0edc884b-f214-41e7-9d1e-14951430e4f7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:18.218146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0edc884b-f214-41e7-9d1e-14951430e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:18.228146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 722/1443] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:18.254083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e60af-a718-47c5-9e54-74bfcc378bce None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:18.271397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e60af-a718-47c5-9e54-74bfcc378bce None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:18.277588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:18.278195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:18.278473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:18.278749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:18.279468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:18.281381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9ae84-8047-4c82-81f2-e32b99274a93 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:18.302828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 722/1444] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Nov 23 12:54:18 2021] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:54:19.904421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3fa-7e93-4f79-9b87-385245a94501 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:19.905031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3fa-7e93-4f79-9b87-385245a94501 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:19.905031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3fa-7e93-4f79-9b87-385245a94501 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:19.906765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 723/1445] 10.222.0.60 () {54 vars in 911 bytes} [Tue Nov 23 12:54:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:19.913101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4f624-4edb-4185-b2b1-7c6707f408f4 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:19.913660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4f624-4edb-4185-b2b1-7c6707f408f4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:19.913819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4f624-4edb-4185-b2b1-7c6707f408f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:19.949588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d8f4f624-4edb-4185-b2b1-7c6707f408f4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:19.951194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d8f4f624-4edb-4185-b2b1-7c6707f408f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:19.962771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 723/1446] 10.222.0.60 () {58 vars in 1008 bytes} [Tue Nov 23 12:54:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:20.122535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2e3fa-7e93-4f79-9b87-385245a94501 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:20.139759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2e3fa-7e93-4f79-9b87-385245a94501 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:20.145855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:20.146501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:20.146785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:20.147064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:20.156636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:20.158631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b362635-9b3d-4371-b4fe-586f7247f1d7 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:20.169474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 724/1447] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:54:22.391267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef96fd-43da-42cf-81de-612521af8113 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:22.391873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef96fd-43da-42cf-81de-612521af8113 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:22.391873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef96fd-43da-42cf-81de-612521af8113 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:22.393762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 724/1448] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:22.399417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425f49f-9b1a-4add-9b6a-b35657494d59 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:22.399929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425f49f-9b1a-4add-9b6a-b35657494d59 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:22.399929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425f49f-9b1a-4add-9b6a-b35657494d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:22.423189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8425f49f-9b1a-4add-9b6a-b35657494d59 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:22.424426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8425f49f-9b1a-4add-9b6a-b35657494d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:22.431831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 725/1449] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:22.470540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef96fd-43da-42cf-81de-612521af8113 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:22.482852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef96fd-43da-42cf-81de-612521af8113 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:22.487253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:22.487836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:22.488122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:22.488443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:22.498243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:22.499681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293de2d-3115-459a-ac0f-e32c4e90e4d6 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:22.509863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 725/1450] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:54:24.781430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4fd6-b287-49e0-bf13-24cda0531319 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:24.782236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4fd6-b287-49e0-bf13-24cda0531319 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:24.782236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4fd6-b287-49e0-bf13-24cda0531319 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:24.783901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 726/1451] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:24.789807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ef62-1cdb-4abd-bc5a-5e114dbd536f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:24.790424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ef62-1cdb-4abd-bc5a-5e114dbd536f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:24.790521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ef62-1cdb-4abd-bc5a-5e114dbd536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:24.815428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f868ef62-1cdb-4abd-bc5a-5e114dbd536f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:24.816624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f868ef62-1cdb-4abd-bc5a-5e114dbd536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:24.824598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 726/1452] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:24.881690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4fd6-b287-49e0-bf13-24cda0531319 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:24.893788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4fd6-b287-49e0-bf13-24cda0531319 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:24.897787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:24.898508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:24.898882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:24.899294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:24.912045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:24.914243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ef9ff-1b7c-4cca-9faa-3a5789425c82 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:24.926314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 727/1453] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:54:27.390638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd722d2-d3a5-4d02-806f-06b9dc5e0314 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:27.391422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd722d2-d3a5-4d02-806f-06b9dc5e0314 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:27.391422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd722d2-d3a5-4d02-806f-06b9dc5e0314 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:27.393187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 727/1454] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:27.400177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900cc4-0444-4572-bddb-5aa44f7ebe7e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:27.400892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900cc4-0444-4572-bddb-5aa44f7ebe7e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:27.400892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900cc4-0444-4572-bddb-5aa44f7ebe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:27.426403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-a0900cc4-0444-4572-bddb-5aa44f7ebe7e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:27.427636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a0900cc4-0444-4572-bddb-5aa44f7ebe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:27.436144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 728/1455] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:27.479881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd722d2-d3a5-4d02-806f-06b9dc5e0314 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:27.492770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd722d2-d3a5-4d02-806f-06b9dc5e0314 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:27.496932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:27.497601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:27.497929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:27.498459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:27.509945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:27.512723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3471-f1ea-41bc-9f1b-a970216bea25 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:27.530796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 728/1456] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:54:30.071714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe94a-f97b-4794-adf4-c82ec482db40 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:30.072347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe94a-f97b-4794-adf4-c82ec482db40 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:30.072347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe94a-f97b-4794-adf4-c82ec482db40 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:30.073996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 729/1457] 10.222.0.60 () {54 vars in 926 bytes} [Tue Nov 23 12:54:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:54:30.081104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15220e7-989e-4cd8-986c-3ee469af8334 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:30.081741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15220e7-989e-4cd8-986c-3ee469af8334 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:30.081741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15220e7-989e-4cd8-986c-3ee469af8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:30.108705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c15220e7-989e-4cd8-986c-3ee469af8334 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:54:30.110011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c15220e7-989e-4cd8-986c-3ee469af8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:54:30.118933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 729/1458] 10.222.0.60 () {58 vars in 1023 bytes} [Tue Nov 23 12:54:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:54:30.166764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe94a-f97b-4794-adf4-c82ec482db40 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:54:30.179592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe94a-f97b-4794-adf4-c82ec482db40 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:54:30.184796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:54:30.185761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:54:30.186265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:54:30.186754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:54:30.202594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:54:30.204469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd150a3-cd2d-440b-a04a-d464edf3b912 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:54:30.216399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 730/1459] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:54:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:55:43.449753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.450392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.450392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.480602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:55:43.481810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:43.489717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 730/1460] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:55:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:55:43.498449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.498962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.499120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.532322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:55:43.533521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:43.541861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 731/1461] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:55:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:55:43.547237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.557906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcad89-6fce-44ea-8b0c-831eeafe68bf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.563870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.564496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.564785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.565064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.565770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:55:43.566064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.567670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.581032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 731/1462] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:55:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:55:43.589643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.598973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610daf2-e95b-4b1a-af08-bd5d67e59742 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.604155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.604800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.605087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.605368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.606045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.608007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.657193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 732/1463] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:55:43 2021] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:55:43.661665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.672909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979988-f99d-47db-b749-90be977cc90a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.746337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.746847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.747133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.747412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.748054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.750008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.772972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 732/1464] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:55:43 2021] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:55:43.777231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.787553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb886f-09af-4c99-8056-827d227c5dbf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.792061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.792696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.792986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.793269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.793971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.795583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.806385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 733/1465] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:55:43.810468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.820623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586384-191a-4ad2-902a-be801fedb05c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.825285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.825882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.826166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.826440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.827138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.829090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429873f-3948-449d-9ce2-3cdd02f6a069 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.839870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 733/1466] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:55:43.846470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:43.856739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890499c-21a0-403f-8592-8e88a9f0d928 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:43.861305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:43.862888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.862888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.862888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] PATH_INFO: `/v3/projects/0bd49ecd32f0468e91e1033e811b4857/users/fc5db449f4d44e8380084eb743f68e6c/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.883605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd49ecd32f0468e91e1033e811b4857, user_id=fc5db449f4d44e8380084eb743f68e6c, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:43.886319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:43.901760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 734/1467] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:55:43 2021] PUT /identity/v3/projects/0bd49ecd32f0468e91e1033e811b4857/users/fc5db449f4d44e8380084eb743f68e6c/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:55:43.914243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72575-a580-46f4-bbb7-b25dfaddc023 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:43.914632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72575-a580-46f4-bbb7-b25dfaddc023 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:43.915020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72575-a580-46f4-bbb7-b25dfaddc023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:43.954352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-67d72575-a580-46f4-bbb7-b25dfaddc023 None None] MFA Rules not processed for user `fc5db449f4d44e8380084eb743f68e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:55:43.955518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-67d72575-a580-46f4-bbb7-b25dfaddc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:44.043311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 734/1468] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:55:43 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:55:44.054487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:44.142937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4353b-7a23-4171-858f-ca3e69594d8f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:44.148835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:44.149434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:44.149722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:44.150004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:44.159159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:44.160831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:44.170690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 735/1469] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:55:44 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:55:44.250221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5e57-c9b3-46b5-8a23-2dd986e529cb None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:44.250541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5e57-c9b3-46b5-8a23-2dd986e529cb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:44.250824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad5e57-c9b3-46b5-8a23-2dd986e529cb None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:44.252490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 735/1470] 10.222.0.60 () {52 vars in 829 bytes} [Tue Nov 23 12:55:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:55:44.256732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:44.327663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f19fa-7377-4014-8936-c1556baca793 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:44.332480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:44.333289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:44.333576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:44.333837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] PATH_INFO: `/v3/users/fc5db449f4d44e8380084eb743f68e6c` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:44.335009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5db449f4d44e8380084eb743f68e6c)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:44.336043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:55:44.336043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:55:44.336043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:55:44.337293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:44.406662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5db449f4d44e8380084eb743f68e6c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:44.416732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5db449f4d44e8380084eb743f68e6c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:44.435280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5db449f4d44e8380084eb743f68e6c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:44.436040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5db449f4d44e8380084eb743f68e6c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:44.436835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5db449f4d44e8380084eb743f68e6c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:44.456279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 736/1471] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:55:44 2021] DELETE /identity/v3/users/fc5db449f4d44e8380084eb743f68e6c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:55:44.461176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:44.461772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:44.461772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:44.484607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:55:44.485799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:44.563303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 736/1472] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:55:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:55:44.574394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:44.575968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:44.643707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf0fe6-ef97-4175-9e4a-58e06488b85a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:44.647893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:44.648509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:44.648798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:44.649077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:44.659149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:44.660628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c91a-3821-49f4-b031-dde97d6b443a service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:44.670335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 737/1473] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:55:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:55:45.125099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:55:45.126677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:55:45.138573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452bf69-01e7-44cd-bb18-bac3ed390fc9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:55:45.143731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:55:45.144586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:55:45.144881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:55:45.145301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] PATH_INFO: `/v3/projects/0bd49ecd32f0468e91e1033e811b4857` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:55:45.146436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd49ecd32f0468e91e1033e811b4857)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:55:45.147469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:55:45.147469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:55:45.147469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:55:45.148791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:55:45.217018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd49ecd32f0468e91e1033e811b4857', 'request_id': 'req-504963ba-c8a1-4c9b-832e-d252c64a4504'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:45.228912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd49ecd32f0468e91e1033e811b4857', 'request_id': 'req-504963ba-c8a1-4c9b-832e-d252c64a4504'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:45.241214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd49ecd32f0468e91e1033e811b4857', 'request_id': 'req-504963ba-c8a1-4c9b-832e-d252c64a4504'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:45.252124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] The token cache is being invalidate because project 0bd49ecd32f0468e91e1033e811b4857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:55:45.252441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:45.253186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-504963ba-c8a1-4c9b-832e-d252c64a4504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:55:45.254887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 737/1474] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:55:45 2021] DELETE /identity/v3/projects/0bd49ecd32f0468e91e1033e811b4857 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:57:13.743833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:13.744575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:13.744575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:13.746641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:57:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:13.752817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982be8d-21f8-4631-aecc-3fb8f94d059e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:13.753330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982be8d-21f8-4631-aecc-3fb8f94d059e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:13.753433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982be8d-21f8-4631-aecc-3fb8f94d059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:13.785926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-0982be8d-21f8-4631-aecc-3fb8f94d059e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:13.787089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0982be8d-21f8-4631-aecc-3fb8f94d059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:13.859159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:57:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:14.013730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:14.016496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:14.102803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8e9b-3ac4-4096-b36a-c431cfd58c25 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:14.108501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:14.109174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:14.109475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:14.109757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:14.118487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:14.120158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c1570-9b6f-4914-92d2-36809cfc4c28 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:14.129745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 739/1477] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:14.576276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81a1a-aa8e-464b-a04b-344285249d8b None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:14.576557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81a1a-aa8e-464b-a04b-344285249d8b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:14.576822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81a1a-aa8e-464b-a04b-344285249d8b None None] PATH_INFO: `/v3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:14.578366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 739/1478] 10.222.0.84 () {54 vars in 925 bytes} [Tue Nov 23 12:57:14 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:57:14.585380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103172-36f1-4c78-817b-1503d48217c8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:14.585667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103172-36f1-4c78-817b-1503d48217c8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:14.585933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29103172-36f1-4c78-817b-1503d48217c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:14.612831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-29103172-36f1-4c78-817b-1503d48217c8 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:14.614016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-29103172-36f1-4c78-817b-1503d48217c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:14.692753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 740/1479] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Nov 23 12:57:14 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:15.512431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46bf0-3775-4515-b383-dabbf033691e None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:15.513406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46bf0-3775-4515-b383-dabbf033691e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:15.513406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46bf0-3775-4515-b383-dabbf033691e None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:15.515907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 740/1480] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:57:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:15.522266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7601b-7e4e-4d40-b868-2adb440e1169 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:15.522977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7601b-7e4e-4d40-b868-2adb440e1169 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:15.523202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7601b-7e4e-4d40-b868-2adb440e1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:15.558337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f0c7601b-7e4e-4d40-b868-2adb440e1169 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:15.559539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f0c7601b-7e4e-4d40-b868-2adb440e1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:15.568964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 741/1481] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:57:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:15.723487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46bf0-3775-4515-b383-dabbf033691e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:15.741751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46bf0-3775-4515-b383-dabbf033691e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:15.748025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:15.748657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:15.748980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:15.749257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:15.757951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:15.759908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fedde-ffc4-48a0-bc65-abe1fd630fb9 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:15.769318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 741/1482] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:23.294202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c20a6-364a-42b9-91ee-f20a37866733 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:23.294736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c20a6-364a-42b9-91ee-f20a37866733 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:23.294837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c20a6-364a-42b9-91ee-f20a37866733 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:23.296704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 742/1483] 10.222.0.60 () {54 vars in 960 bytes} [Tue Nov 23 12:57:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:23.302140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957624-9c30-414f-bb07-b260b7102ff8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:23.302631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957624-9c30-414f-bb07-b260b7102ff8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:23.302749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957624-9c30-414f-bb07-b260b7102ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:23.326714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-58957624-9c30-414f-bb07-b260b7102ff8 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:23.327867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-58957624-9c30-414f-bb07-b260b7102ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:23.343144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 742/1484] 10.222.0.60 () {58 vars in 1057 bytes} [Tue Nov 23 12:57:23 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:23.352124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c20a6-364a-42b9-91ee-f20a37866733 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:23.370366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c20a6-364a-42b9-91ee-f20a37866733 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:23.376584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:23.377154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:23.377434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:23.377712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:23.386216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:23.387806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff7cfb-42c7-4419-a67a-2410ede64902 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:23.397381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 743/1485] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:27.542630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c372d7-41df-420f-aba8-a7576f0a1a5d None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:27.543601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c372d7-41df-420f-aba8-a7576f0a1a5d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:27.543601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c372d7-41df-420f-aba8-a7576f0a1a5d None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:27.544949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:57:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:27.551705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435901c-c2d8-45f9-b8b0-9637d2fba3c8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:27.552380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435901c-c2d8-45f9-b8b0-9637d2fba3c8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:27.552380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435901c-c2d8-45f9-b8b0-9637d2fba3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:27.576639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3435901c-c2d8-45f9-b8b0-9637d2fba3c8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:27.577874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3435901c-c2d8-45f9-b8b0-9637d2fba3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:27.586596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:57:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:27.739328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c372d7-41df-420f-aba8-a7576f0a1a5d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:27.754162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c372d7-41df-420f-aba8-a7576f0a1a5d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:27.759900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:27.760518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:27.760805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:27.761093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:27.770637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:27.772254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301ebc-45a7-4b67-b848-5189c8cbb142 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:27.782443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 744/1488] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:29.137869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afe9d1-6003-47b5-b3e7-82dd7a37f056 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:29.138554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afe9d1-6003-47b5-b3e7-82dd7a37f056 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:29.138554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afe9d1-6003-47b5-b3e7-82dd7a37f056 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:29.140064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 12:57:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:29.145796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527266-ef15-4ec9-a7f6-0f578172407e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:29.146321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527266-ef15-4ec9-a7f6-0f578172407e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:29.146429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527266-ef15-4ec9-a7f6-0f578172407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:29.176997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-53527266-ef15-4ec9-a7f6-0f578172407e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:29.178175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-53527266-ef15-4ec9-a7f6-0f578172407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:29.185501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 12:57:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:29.344939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afe9d1-6003-47b5-b3e7-82dd7a37f056 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:29.364380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afe9d1-6003-47b5-b3e7-82dd7a37f056 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:29.371962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:29.372766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:29.373213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:29.373525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:29.386427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:29.389621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff4c53-b153-46bc-9061-f38a6b5577cd service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:29.402813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 746/1491] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:33.466088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:33.466731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:33.466731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:33.468357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:57:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:33.474109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12b57-257e-4f50-b918-7fe48c4b8f54 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:33.474635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12b57-257e-4f50-b918-7fe48c4b8f54 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:33.474635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12b57-257e-4f50-b918-7fe48c4b8f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:33.499600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-90f12b57-257e-4f50-b918-7fe48c4b8f54 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:33.500919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-90f12b57-257e-4f50-b918-7fe48c4b8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:33.509986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:57:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:33.547708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:33.549612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:33.617465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a54544-1649-46f9-817c-b6222d5405e7 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:33.621066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:33.621692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:33.621974 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:33.622247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:33.632254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:33.634063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c4ec6-59bd-4329-ad12-46fbb0e83c2f service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:33.643710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 747/1494] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:35.800902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8371f-a6b0-4d36-9329-dd08c22c5f67 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:35.801937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8371f-a6b0-4d36-9329-dd08c22c5f67 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:35.802391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8371f-a6b0-4d36-9329-dd08c22c5f67 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:35.804664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:57:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:35.811185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6cc94-a3a4-458e-9261-adf40b542e23 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:35.811746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6cc94-a3a4-458e-9261-adf40b542e23 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:35.811746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6cc94-a3a4-458e-9261-adf40b542e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:35.836154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-cef6cc94-a3a4-458e-9261-adf40b542e23 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:35.837583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cef6cc94-a3a4-458e-9261-adf40b542e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:35.845946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:57:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:35.882675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8371f-a6b0-4d36-9329-dd08c22c5f67 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:35.894239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8371f-a6b0-4d36-9329-dd08c22c5f67 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:35.897875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:35.898474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:35.898754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:35.899029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:35.908763 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:35.910203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eb0d2-04af-4e5e-9041-1c1034f3a64c service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:35.919425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 749/1497] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:39.481065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:39.481933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:39.482129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:39.483998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:57:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:39.490434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf27ad-3c34-48a5-ab49-60ff5602aa81 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:39.490935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf27ad-3c34-48a5-ab49-60ff5602aa81 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:39.491031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf27ad-3c34-48a5-ab49-60ff5602aa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:39.517258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ddcf27ad-3c34-48a5-ab49-60ff5602aa81 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:39.518422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ddcf27ad-3c34-48a5-ab49-60ff5602aa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:39.525919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:57:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:39.586375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:39.589109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:39.659870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0a052-03dd-45ee-8ac3-26fcb6cd108e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:39.664076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:39.664694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:39.664973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:39.665248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:39.675195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:39.676644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945849b-17f1-455a-a3e4-7068a83e33a7 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:39.687578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 750/1500] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:57:41.782620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955804a-8099-4228-a7fb-68070c379358 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:41.783292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955804a-8099-4228-a7fb-68070c379358 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:41.783447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955804a-8099-4228-a7fb-68070c379358 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:41.785219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 751/1501] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 12:57:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:41.791478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af07f-a7d1-4426-969f-fe090fe4142a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:41.792209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af07f-a7d1-4426-969f-fe090fe4142a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:41.792336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af07f-a7d1-4426-969f-fe090fe4142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:41.816313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-298af07f-a7d1-4426-969f-fe090fe4142a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:41.817534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-298af07f-a7d1-4426-969f-fe090fe4142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:41.826276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 751/1502] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 12:57:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:41.885018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e4ff-9876-48c2-a587-8556ebc6ec4b None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:41.885265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e4ff-9876-48c2-a587-8556ebc6ec4b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:41.885563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e4ff-9876-48c2-a587-8556ebc6ec4b None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:41.887354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 752/1503] 10.222.0.60 () {54 vars in 962 bytes} [Tue Nov 23 12:57:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:57:41.893212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925b9-986e-4f65-8a7e-27324e28397c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:41.893617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925b9-986e-4f65-8a7e-27324e28397c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:41.894028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925b9-986e-4f65-8a7e-27324e28397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:41.922454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c95925b9-986e-4f65-8a7e-27324e28397c None None] MFA Rules not processed for user `4f54266b73f542309722b317e80e5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:57:41.923639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c95925b9-986e-4f65-8a7e-27324e28397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:57:41.929868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 752/1504] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Nov 23 12:57:41 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:57:41.937847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e4ff-9876-48c2-a587-8556ebc6ec4b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:57:41.949973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e4ff-9876-48c2-a587-8556ebc6ec4b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:57:41.954133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:57:41.954867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:57:41.955235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:57:41.955536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:57:41.965550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:57:41.966993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59be6a2-deb8-401e-b0de-20d73dfdbde8 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:57:41.976644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 753/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:57:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:15.159561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.160148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.160459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.188826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.190228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.202148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 753/1506] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.211988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.213085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.213944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.247946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.249193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.263024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 754/1507] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.267870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.281881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1018f7-de8c-4e69-897f-037ef3744aa2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.292704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.293307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.293592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.293872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.294580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:15.294880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.296566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02391709-aaf6-4876-89d5-c9010fc23bea admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.314223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 754/1508] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:15.322988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.337946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e746c7d-2156-43b1-9b3b-48add9d7402a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.346252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.347022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.347312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.347592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.348273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.350368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.387865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29185d-e451-4340-83b1-918b55eca7c3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.388226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29185d-e451-4340-83b1-918b55eca7c3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.388606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29185d-e451-4340-83b1-918b55eca7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.398674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 755/1509] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:15.413167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.425328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3e29185d-e451-4340-83b1-918b55eca7c3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.426559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3e29185d-e451-4340-83b1-918b55eca7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.560262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 755/1510] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.560262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.560262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.560262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.563164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70817fb-901f-4bfe-9bea-c4fa7a4dc0a8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.574199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.575204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.575704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.576198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.577078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.579230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e260-8418-4ea9-925a-49c166c53f76 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.606266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.609629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.616520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 756/1511] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:15.618104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b40e-817d-46f5-9da8-4710725d4a63 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.618629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b40e-817d-46f5-9da8-4710725d4a63 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.619214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76b40e-817d-46f5-9da8-4710725d4a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.624262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 756/1512] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.624578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.639533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1b93e-e627-46e8-b028-721ae72b25dc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.651334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.651950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.652250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.652533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.653241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.654845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e9ddc-dd76-4e27-94ce-2d6cc1433f52 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.657600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9f76b40e-817d-46f5-9da8-4710725d4a63 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.659347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9f76b40e-817d-46f5-9da8-4710725d4a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.675422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 757/1513] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:59:15.676999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.677296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.677740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.678588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 757/1514] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.680069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.680389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.680671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.709416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.710859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.713775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.714925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.722272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 758/1515] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.722999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.730534 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 758/1516] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.731842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.736056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90d261-34bc-40c5-999a-5192edf6885e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.741509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.742109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.742307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87c71-f814-4b2e-a654-9f16b56ab010 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.742445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.742653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.743383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.745224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf21b7-2fce-4b67-84a8-279c9b3e9a9d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.746932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.747561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.747979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.748147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.748860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:15.749405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.750770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e3af-2ab7-48ca-ab93-b11b844bd21b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.756501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 759/1517] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:15.758536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951299-d614-4227-8e5f-e7ace831176b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.758536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951299-d614-4227-8e5f-e7ace831176b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.758536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951299-d614-4227-8e5f-e7ace831176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.766923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 759/1518] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:15.768063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.768384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.768663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.783294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-93951299-d614-4227-8e5f-e7ace831176b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.784502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93951299-d614-4227-8e5f-e7ace831176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.792805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 760/1519] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.793453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.794012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.794304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.794586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.795315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.820296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 760/1520] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.820296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.826034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c8db-b479-41d7-b8a5-1a49e961599f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.830353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.831202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.831639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.831994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.833331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:15.833776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.835512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15664-56e4-41a7-8ee1-a2565a2857b5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.843879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.845076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.857252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 761/1521] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:15.857252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.857252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.857252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.860622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 761/1522] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.861439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.873965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aac3a7-904d-461e-b1c5-3bf49dc89190 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.878368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.879223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.879512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.879794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] PATH_INFO: `/v3/projects/d3e13e13e1e54f208b7be1c18e3ab703/users/4540fb62ff264ba4929a567b548de846/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.881106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.882262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.890189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 762/1523] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:15.890620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:15.899384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2dfa8-8c5f-43ad-bb6a-053ce2422025 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:15.902908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e13e13e1e54f208b7be1c18e3ab703, user_id=4540fb62ff264ba4929a567b548de846, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.903792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:15.904550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.904835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.905111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.905749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:15.905862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd633-e8a8-4933-bca0-390fbe38239d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.907635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8bdea-3880-432a-9bbd-36d70082885b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:15.921353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 762/1524] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:15 2021] PUT /identity/v3/projects/d3e13e13e1e54f208b7be1c18e3ab703/users/4540fb62ff264ba4929a567b548de846/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:15.922418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d729f-94bf-41ae-af7a-5c77d9430996 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.923118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d729f-94bf-41ae-af7a-5c77d9430996 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.923118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d729f-94bf-41ae-af7a-5c77d9430996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.940421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 763/1525] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:15.940421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:15.940421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:15.940421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:15.946450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-698d729f-94bf-41ae-af7a-5c77d9430996 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.947781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-698d729f-94bf-41ae-af7a-5c77d9430996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:15.962543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:15.963769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:16.013781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 763/1526] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.015110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcded6c-69bb-4db6-bff3-ccf50230c019 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.015440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcded6c-69bb-4db6-bff3-ccf50230c019 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.015717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcded6c-69bb-4db6-bff3-ccf50230c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.033615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 764/1527] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.034544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.040445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8bcded6c-69bb-4db6-bff3-ccf50230c019 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:16.041620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8bcded6c-69bb-4db6-bff3-ccf50230c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:16.044104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b826d50-ab5b-4875-affe-f5c7b7615341 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.048453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.049028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.049315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.049603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.049992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 764/1528] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.050242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.051249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831719-ce2f-427f-8844-64110c3048a4 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.051541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831719-ce2f-427f-8844-64110c3048a4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.051826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831719-ce2f-427f-8844-64110c3048a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.052325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.075221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-49831719-ce2f-427f-8844-64110c3048a4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:16.076534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-49831719-ce2f-427f-8844-64110c3048a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:16.084806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 765/1529] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.084806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.087530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 765/1530] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.088917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.089234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.089983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.116581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:16.117799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:16.159178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bd0cb-b458-407f-8ebb-938677df45a6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.163633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.164256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.164765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.165241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.167161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:16.167447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.169168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.181760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 766/1531] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:16.182368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.191651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 766/1532] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.192342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e06-ad09-497d-a35c-391d432f17a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.192515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.196771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.197411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.197692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.197968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.198634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.200723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.202849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4be26-77e4-4f20-b8c0-2687e9c82b11 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.207582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.207858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.208124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.208432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.209158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:16.209443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.211279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a834f-8129-472a-b8ab-253906d91482 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.223103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 767/1533] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.227130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.229746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 767/1534] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:16.231189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.231543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.232085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.233976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c40e3-29f0-4ee2-97b9-22778605c06e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.240040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.240653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.241083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.241354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.242050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:16.242345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.244400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.257717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 768/1535] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:16.258507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.259640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:16.261190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:16.268673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abc6a-f320-444e-aeea-353962ac3349 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.273447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.273778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 768/1536] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:16.274058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.274370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.274611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.274696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.275477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.277746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.284044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085ee52-79e0-4f57-9746-0dcc9fdaac24 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.288689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.289340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.289583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.289864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.290549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:16.290954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.292653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.298312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 769/1537] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.302229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.306316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 769/1538] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:16.311661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eec802-6e02-4d4f-8f73-5e4359c244fa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.314531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.316043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.316664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.316950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.317303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.317921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.319829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.352902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 770/1539] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.352902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.379882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847b2f-91b3-48e7-9581-0a0404d48119 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.429101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6020a7-99ab-4adc-8c98-938afd818f96 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.435625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.436267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.436564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.436880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.439150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.439298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.440141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.440758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.441046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.441303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.451667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.451856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 771/1540] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:16.452826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.453070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.462808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 770/1541] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:16.463636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.464645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8a2af-f532-4d23-b2b1-f9c28901b958 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.470524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.471134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.471416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.472023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.472525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.473623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219646b0-011a-43b7-87ec-ec31fdd42d08 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.474551 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.482543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.483739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.483870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.484076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.484763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.486682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.510796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 772/1542] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.513664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.526251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 771/1543] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.526251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.608486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354da16-526a-4020-8945-2357bae44b5f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.608770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6155d-f00a-479e-932a-8201bede3f56 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.614107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.614636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.614768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.615104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.615292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.615573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.615680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.615841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.616369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:16.616582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.616751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.618192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.618466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.633236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 772/1544] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:16.633236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.637696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 773/1545] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:16.646068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.646386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdec40-4055-443d-9eb2-a328ee237b0a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.649166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.649286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.649503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.649778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.650779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.652392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969054d-3a1c-42ef-967b-fd91e5cb28a7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.652790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.657241 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.657917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.658128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.658407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.659043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.661356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.686728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 773/1546] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.686839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 774/1547] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.686931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.687017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.697262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373899-dab2-44d9-8f9a-8eb0eac71e4e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.762937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1da4-bcf7-4057-bb16-0e8d85cc832d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.768028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.768980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.769479 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.769721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.770432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.772068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.777890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.778511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.778803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.779081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.779731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.781726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.783595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 774/1548] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:16.784252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.793914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0fe46-bcf3-489d-a0c9-24da4b7466a0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.800969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.802268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.802817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.803885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.805153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.806178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 775/1549] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.807190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.809445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.817124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620697-3192-4f9e-8200-6cb0ab7941bb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.822935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.823571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.823919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.824206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.824968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.826606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.838087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 776/1550] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:16.838976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.848369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 775/1551] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 296 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.848369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.856331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696483cd-520f-440d-912f-9e9381deb9f5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.862714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.863558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.863915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.864274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.865118 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.867408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.875478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3b07-2070-41dd-a72b-ae1ab2523c84 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.881662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:16.882563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:16.883199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:16.883442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:16.884161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:16.886315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:16.911296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 776/1552] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/users => generated 284 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.912166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:16.922246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea372ff5-87dd-41a6-a762-0fc217dc9df2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:16.922805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 777/1553] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:16 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:16.923606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.004611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.005258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.005556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.006317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.007606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.009710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.024127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 777/1554] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.025528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.026074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb12e-5ea3-42ac-b850-5540e2161882 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.035063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.036064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.036388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.036662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] PATH_INFO: `/v3/projects/0fa722c7481547ba84a53135a4716aec/users/a4d943e4e5b547cfbe2dc0b3c53d189a/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.038404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61b9-1f60-4af7-bf4d-7b330ad18457 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.044861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.045514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.045807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.046087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.047241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.049469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.063390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa722c7481547ba84a53135a4716aec, user_id=a4d943e4e5b547cfbe2dc0b3c53d189a, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.064551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 778/1555] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.065656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.066703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.076537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3115-42fe-4e30-b4d5-af4653a7cedf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.083751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 778/1556] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:16 2021] PUT /identity/v3/projects/0fa722c7481547ba84a53135a4716aec/users/a4d943e4e5b547cfbe2dc0b3c53d189a/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:17.084720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.163892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.164775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.165162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.171279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] PATH_INFO: `/v3/projects/8a1db1f28b6949fcaa1c08a2158ab950/users/499c3ea7403049119285bb3423929f9d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.192839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1db1f28b6949fcaa1c08a2158ab950, user_id=499c3ea7403049119285bb3423929f9d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.195669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.204500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a866-3fb1-429f-bbe8-2b3084e5386e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.212114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.212689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.213025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.213325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 779/1557] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:17 2021] PUT /identity/v3/projects/8a1db1f28b6949fcaa1c08a2158ab950/users/499c3ea7403049119285bb3423929f9d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:17.224920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.225394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.225482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.225482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.228205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 779/1558] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.229243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.243196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2b19-0b56-47c3-9466-28eebee41242 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.300492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2bb1-d7ce-4d07-ab23-490dbf3f186b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.305209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.305803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.306090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.306369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.307108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.308832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.311999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.312696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.313037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.313394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.314139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.316450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.319478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 780/1559] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.320518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.330445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda311d6-da62-43a1-838f-9686b9995ee3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.335295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.335808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.336098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.336590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.337182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.339022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fafb4-93a8-4196-adaa-1833913ad905 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.344453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 780/1560] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:17 2021] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:17.344453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.351878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60baad5-5a9c-421c-b646-60485634b74b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.355978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 781/1561] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.355978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.355978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.355978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.361228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.361915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.362272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.362598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.363689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.365380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e52b-c464-457c-8e63-6658bbb8074b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.380473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 781/1562] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.382285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.382639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.382980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.393919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] MFA Rules not processed for user `a4d943e4e5b547cfbe2dc0b3c53d189a`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:17.395117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:17.431727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] MFA Rules not processed for user `499c3ea7403049119285bb3423929f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:17.433397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:17.487720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 782/1563] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:17 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:17.489157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.502955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42698454-f302-4320-9f9a-91b31a5d3eae None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.508716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.509518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.509852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.510127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.511121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.513150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.537639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 783/1564] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.537639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.546037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 782/1565] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:17 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:17.547064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.550289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0415-9dea-40b6-b8fa-a6cc65fcef4b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.556136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.556915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.557202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.557487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.558218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.559869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.562575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585984a-decb-4713-bfd5-a78203cd643f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.569483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.570206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.570503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.570796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.571545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.573509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.584548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 784/1566] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.584548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.588757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 783/1567] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:17.589702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.597841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b5e72-d4d3-4f71-ade2-6565244c20a4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.602466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0d08-4022-4627-81f2-103b5fcc9055 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.602693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.603783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.604207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.604559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] PATH_INFO: `/v3/projects/7d153c67e84449bb8eb36b752ec41896/users/bb7adc68cc5d47fea458da9232672087/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.609053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.610774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.611354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.611608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] PATH_INFO: `/v3/projects/9a31364455dc442f8df299a8ad758a4e/users/c023f89fd3da4bc8b38963bed4e5cc63/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.628834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d153c67e84449bb8eb36b752ec41896, user_id=bb7adc68cc5d47fea458da9232672087, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.631917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3489-002b-4870-8416-74d945a81179 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.638548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a31364455dc442f8df299a8ad758a4e, user_id=c023f89fd3da4bc8b38963bed4e5cc63, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.641823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.649083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 785/1568] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:17 2021] PUT /identity/v3/projects/7d153c67e84449bb8eb36b752ec41896/users/bb7adc68cc5d47fea458da9232672087/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:17.651155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63616-fd60-4f35-a64b-29ad3dd16587 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.651643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63616-fd60-4f35-a64b-29ad3dd16587 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.652141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63616-fd60-4f35-a64b-29ad3dd16587 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.654107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 786/1569] 10.222.0.60 () {54 vars in 959 bytes} [Tue Nov 23 12:59:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:17.655021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e63616-fd60-4f35-a64b-29ad3dd16587 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.665539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 784/1570] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:17 2021] PUT /identity/v3/projects/9a31364455dc442f8df299a8ad758a4e/users/c023f89fd3da4bc8b38963bed4e5cc63/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:17.670104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.743748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8c749-5fd6-4095-a78b-f11452b1259a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.749441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.750323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.750649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.750971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.751748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.756139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.762529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e63616-fd60-4f35-a64b-29ad3dd16587 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.768118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.769735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.770093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.770443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] PATH_INFO: `/v3/projects/9bd7c1ce491e474c970f1a7cc5effe19/users/9285e1edf7ed42029c54bcc4f86abda7/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.793278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 785/1571] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:17 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:17.793882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.810376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd7c1ce491e474c970f1a7cc5effe19, user_id=9285e1edf7ed42029c54bcc4f86abda7, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.816870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.842457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 787/1572] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:17 2021] PUT /identity/v3/projects/9bd7c1ce491e474c970f1a7cc5effe19/users/9285e1edf7ed42029c54bcc4f86abda7/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:17.845239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:17.883832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f6708-9220-4591-9dc9-943226546e5e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.960848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.962029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.962319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.962681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] PATH_INFO: `/v3/projects/a2f9123ebba5429d822532e9bd32d324/users/77fd0e2694434d88be9ab3153f881a15/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.977235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f2400-9e32-4bee-89c5-579ee44020c1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:17.983145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:17.983874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:17.984230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:17.984836 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:17.985742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.985865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f9123ebba5429d822532e9bd32d324, user_id=77fd0e2694434d88be9ab3153f881a15, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:17.988119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b8a37-88d1-4478-b816-8810cc649194 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:17.988570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89530ec3-8035-4672-a026-20a6ca81dba9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.000798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 788/1573] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:18.005400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d53c6-b680-4366-a220-2ea8edda6133 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.006096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d53c6-b680-4366-a220-2ea8edda6133 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.006448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d53c6-b680-4366-a220-2ea8edda6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.006837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 786/1574] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:17 2021] PUT /identity/v3/projects/a2f9123ebba5429d822532e9bd32d324/users/77fd0e2694434d88be9ab3153f881a15/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:18.020465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.020751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.021032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.033195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-020d53c6-b680-4366-a220-2ea8edda6133 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.034494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-020d53c6-b680-4366-a220-2ea8edda6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.049388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.050562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.116272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 789/1575] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.116272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788338db-34ba-4ae9-ba63-940e8b004460 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.116272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788338db-34ba-4ae9-ba63-940e8b004460 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.116272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788338db-34ba-4ae9-ba63-940e8b004460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.146163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-788338db-34ba-4ae9-ba63-940e8b004460 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.147950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-788338db-34ba-4ae9-ba63-940e8b004460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.151838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 787/1576] 10.222.0.60 () {58 vars in 1056 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.153106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.157551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 790/1577] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.159050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.159357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.159657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.176262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78fa4-38b4-488d-a602-8766fc4b510f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.181892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.182929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.183431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.183956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.184883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.186437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.187370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0f450-ec2b-4bf0-8a05-1fb4b219f1d9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.187801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.196782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 791/1578] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.197915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.209171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc86f5c-43fa-4a11-8fdc-57628ec54f3c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.220608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 788/1579] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:18.220947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.222021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.222443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.222927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.223195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.223537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.223860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] PATH_INFO: `/v3/projects/a292a89d27674cf4adad86f87af6e648/users/350d2fc53c4d4a2fb223356796c8faba/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.250312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a292a89d27674cf4adad86f87af6e648, user_id=350d2fc53c4d4a2fb223356796c8faba, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.254224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.285005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 792/1580] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:18 2021] PUT /identity/v3/projects/a292a89d27674cf4adad86f87af6e648/users/350d2fc53c4d4a2fb223356796c8faba/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:18.286153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.292637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] MFA Rules not processed for user `77fd0e2694434d88be9ab3153f881a15`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.294047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.365310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55610-7d79-4def-a3bb-bbc5531081ec admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.369898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.370484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.370780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.371188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.384537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 789/1581] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.385837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.470181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.476751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.479542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24293d3-f00f-4ad7-9c2a-5f59f1505e32 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.487309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.488818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.489334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.489781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.490752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 793/1582] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:18.491763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.507741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10a55-8460-4a56-945e-20bb0b54800e service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.514258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.515880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.516765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.517703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.541188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.545504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.571542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 794/1583] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:18.572729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.580633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.582219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.591782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ab73-7c5b-45a4-8ed0-fb91609a32f0 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.598712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 790/1584] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:18 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:18.600945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.601590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.601928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.602205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.603040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.621378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.622851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f62f9-9463-4031-85e3-4ca7d9986e1e service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.627980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232709-24e1-446c-bc9b-72c6e05bfb6a service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.638257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.638849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.639137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.639416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.640149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.641828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.655893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 795/1585] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:18.657984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.658512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.659112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.664968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 791/1586] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:18 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:18.666246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.694814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37feb1a-09eb-4e7b-80d1-5297cb8f9253 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.708718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.709610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.710578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.711007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.712053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.714863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:18.750205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] MFA Rules not processed for user `350d2fc53c4d4a2fb223356796c8faba`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:18.751885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:18.763299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 792/1587] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:18.764723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.888802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18e6da-e896-4dad-aab2-3f8c875a4603 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.897713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.898887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.899318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.910073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] PATH_INFO: `/v3/projects/836d671d99264c739052666285f99d44/users/7b47bf40c9ee48a2a19b22316be438c3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.941939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 796/1588] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:18.942931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:18.964126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a077e3-4d48-496a-929a-1740bc761173 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:18.979596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:18.980225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:18.980547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:18.980933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:18.981762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:18.992478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764249-1846-426a-9e88-f9fc7f736f03 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.011228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=836d671d99264c739052666285f99d44, user_id=7b47bf40c9ee48a2a19b22316be438c3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.035244 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0139696-6eec-45ff-9c79-86181a9b51ad admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.048183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 797/1589] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:18 2021] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:19.050202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4247d5-5316-417d-84dc-de410fbe43b3 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.050714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4247d5-5316-417d-84dc-de410fbe43b3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.051128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4247d5-5316-417d-84dc-de410fbe43b3 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.053449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 798/1590] 10.222.0.60 () {54 vars in 959 bytes} [Tue Nov 23 12:59:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:19.054591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4247d5-5316-417d-84dc-de410fbe43b3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.071818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 793/1591] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:18 2021] PUT /identity/v3/projects/836d671d99264c739052666285f99d44/users/7b47bf40c9ee48a2a19b22316be438c3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:19.079041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.082202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.083439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.148590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:19.150478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:19.236293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4247d5-5316-417d-84dc-de410fbe43b3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.242495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.243046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.243336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.243610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.244709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.248500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.268937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 799/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:19.268937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.285596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658aae8-b4e2-415c-9532-091edc8c9f56 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.291973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.292627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.293071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.293360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.294101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.296627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e68c7-2594-48f7-8c39-34e6575d663b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.310954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 794/1593] 10.222.0.60 () {58 vars in 1056 bytes} [Tue Nov 23 12:59:19 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:19.312079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 800/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:19.313149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.313558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5940d-f3cf-47d4-84cb-84aab8574c56 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.313976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5940d-f3cf-47d4-84cb-84aab8574c56 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.314275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5940d-f3cf-47d4-84cb-84aab8574c56 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.326779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe326749-d11a-4316-b134-b7818370f4ee None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.332443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 801/1595] 10.222.0.60 () {54 vars in 912 bytes} [Tue Nov 23 12:59:19 2021] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:19.336936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5940d-f3cf-47d4-84cb-84aab8574c56 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.339119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.339949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.340472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.340765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] PATH_INFO: `/v3/projects/57191111351f4f5f84a8cd0f6c801225/users/0694ed6645264163ba4c389b0adfcf60/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.359837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5940d-f3cf-47d4-84cb-84aab8574c56 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.364613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=57191111351f4f5f84a8cd0f6c801225, user_id=0694ed6645264163ba4c389b0adfcf60, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.367411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.367625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.369290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.370477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.371157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] PATH_INFO: `/v3/projects/836d671d99264c739052666285f99d44/users/7b47bf40c9ee48a2a19b22316be438c3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.376256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] RBAC: Authorizing `identity:create_grant(project_id=836d671d99264c739052666285f99d44, user_id=7b47bf40c9ee48a2a19b22316be438c3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.379153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a387-670f-4eba-af79-d293b45b339d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.392476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 795/1596] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:19 2021] PUT /identity/v3/projects/57191111351f4f5f84a8cd0f6c801225/users/0694ed6645264163ba4c389b0adfcf60/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:19.393589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.399758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 802/1597] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:19 2021] PUT /identity/v3/projects/836d671d99264c739052666285f99d44/users/7b47bf40c9ee48a2a19b22316be438c3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:19.408827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.408827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.408827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.434170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:19.437636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:19.490028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859413d1-7c74-4d2e-bc34-a9d2d6c9d1ea admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.524388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 803/1598] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:59:19 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:19.525281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.582290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.582901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.583186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.583468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.618077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf067a6-bc50-46e0-9afb-c505c5659f06 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.635781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.637162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.639162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.639681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.641215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.643904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e11e04-2f59-454d-b86d-617062930f47 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.660535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 804/1599] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:19.662279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.662800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.663308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.704850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.707104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.737311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 796/1600] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:19.738550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.739460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] MFA Rules not processed for user `7b47bf40c9ee48a2a19b22316be438c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:19.741579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:19.890497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689061ed-23be-40f4-aedf-c3b9ec7705d7 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.904176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.904993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.905529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.905910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.923465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 805/1601] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:19 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:19.927488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.928374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.930830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.943912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef735d-e306-41ae-b7c8-e2e20fee07fb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:19.950887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:19.952226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:19.952732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:19.953251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] PATH_INFO: `/v3/projects/57191111351f4f5f84a8cd0f6c801225/users/0694ed6645264163ba4c389b0adfcf60/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:19.955935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57191111351f4f5f84a8cd0f6c801225, user_id=0694ed6645264163ba4c389b0adfcf60, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:19.960274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 797/1602] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:19.961358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:19.972052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a6d4-08f2-4157-8cac-2f4525390837 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:19.980299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a8e0-36a7-4013-88be-a99bf7ea1d00 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:20.001318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 806/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:19 2021] PUT /identity/v3/projects/57191111351f4f5f84a8cd0f6c801225/users/0694ed6645264163ba4c389b0adfcf60/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:20.013205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.013607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.013980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.069001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] MFA Rules not processed for user `0694ed6645264163ba4c389b0adfcf60`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:20.070772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:20.119467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:20.120292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.120690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.121081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.347834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 807/1604] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:20 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:20.368883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:20.375401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a261c37-3376-4531-b26d-32fb557350a5 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:20.399823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 798/1605] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:19 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:20.470349 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:20.480291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d1741-abd5-4c32-8321-3b2be06629fa None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.480761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d1741-abd5-4c32-8321-3b2be06629fa None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.481654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d1741-abd5-4c32-8321-3b2be06629fa None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.483583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 799/1606] 10.222.0.60 () {54 vars in 912 bytes} [Tue Nov 23 12:59:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 12:59:20.490303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.490747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.491173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.499802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8a34-c021-4a67-b079-c020c8d52ae9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:20.509772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:20.510631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.512497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.513526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.541530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:20.546539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:20.553032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:20.556063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:20.583011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 808/1607] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:20 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:20.745857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 800/1608] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:59:20 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:20.747969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:20.759957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1825b-b751-4c28-a9a2-78366703cc04 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:20.765769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:20.766415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:20.766785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:20.767124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:20.881661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:20.885932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:20.915019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 809/1609] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:20 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:21.052434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:21.064922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27752d4-41c3-4ab9-a19e-ab81a4f5bdb7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:21.079243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:21.080559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:21.080920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:21.081275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:21.281892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:21.283498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a65d8-7b15-4b91-84b3-f936da080228 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:21.330283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 801/1610] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:21 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:21.641104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:21.659622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e73b-47e7-4a66-a3da-29a0a5e8f286 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:21.664344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:21.665493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:21.665865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:21.666184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:21.678653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:21.680102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:21.691453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 810/1611] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:21 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:22.186071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491dca-eb74-4657-a07f-a965fbcad247 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:22.186655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491dca-eb74-4657-a07f-a965fbcad247 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:22.186737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491dca-eb74-4657-a07f-a965fbcad247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:22.215246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:22.270593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ea491dca-eb74-4657-a07f-a965fbcad247 None None] MFA Rules not processed for user `bb7adc68cc5d47fea458da9232672087`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:22.272006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ea491dca-eb74-4657-a07f-a965fbcad247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:22.361440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5a82-5b6f-49eb-9464-b0de943555c4 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:22.366878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:22.367706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:22.367987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:22.368272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] PATH_INFO: `/v3/users/350d2fc53c4d4a2fb223356796c8faba` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:22.370452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=350d2fc53c4d4a2fb223356796c8faba)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:22.371698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: WARNING py.warnings [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:22.371698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: warnings.warn(msg) Nov 23 12:59:22.371698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: Nov 23 12:59:22.373721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:22.463475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 802/1612] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:22 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:22.476078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:22.476587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:22.476923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:22.517146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350d2fc53c4d4a2fb223356796c8faba'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:22.528983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] MFA Rules not processed for user `bb7adc68cc5d47fea458da9232672087`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:22.532465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350d2fc53c4d4a2fb223356796c8faba'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:22.532637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:22.561870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 803/1613] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:22 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:22.563719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350d2fc53c4d4a2fb223356796c8faba'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:22.564644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350d2fc53c4d4a2fb223356796c8faba'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:22.565249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3c0d84d6-0380-4a55-9deb-877d6794d36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350d2fc53c4d4a2fb223356796c8faba'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:22.571394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:22.587697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddd8a-2183-49e4-9e8c-607b63402b67 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:22.594818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:22.595472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:22.595762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:22.596044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:22.597227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 811/1614] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:22 2021] DELETE /identity/v3/users/350d2fc53c4d4a2fb223356796c8faba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:22.601488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:22.602152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358b2d-d1ec-4fd6-8a1b-f7b2da643eef None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:22.602442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358b2d-d1ec-4fd6-8a1b-f7b2da643eef None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:22.602841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358b2d-d1ec-4fd6-8a1b-f7b2da643eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:22.614385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:22.616150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:22.647775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 804/1615] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:22 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:22.656660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-29358b2d-d1ec-4fd6-8a1b-f7b2da643eef None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:22.657845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-29358b2d-d1ec-4fd6-8a1b-f7b2da643eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:22.800729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 812/1616] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:22.875507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:22.877629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:23.042707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62ace9-11c2-4216-b918-aebcb7eccbce service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:23.258568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:23.260170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.260787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.261126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.283539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:23.287413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbce0-a8fa-4ee9-989a-2a3a7c9ddec4 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:23.308934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64101c-c7b8-4c16-a880-6600737b8cdf None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.309996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64101c-c7b8-4c16-a880-6600737b8cdf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.310432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64101c-c7b8-4c16-a880-6600737b8cdf None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.312602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 813/1617] 10.222.0.60 () {54 vars in 912 bytes} [Tue Nov 23 12:59:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:23.318217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.318792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.319223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.336996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 805/1618] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:23.442001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:23.444362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:23.468128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 814/1619] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:59:23 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:23.485911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.486050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.486284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.507985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:23.510305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:23.526942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2c453-d17e-42db-b522-22721a173a89 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:23.546046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:23.547798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.548721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.549843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.568426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:23.572864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213d80-0bd4-43fe-88cf-cec8fd7623ab service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:23.595100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 815/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:23 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:23.604743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] MFA Rules not processed for user `c023f89fd3da4bc8b38963bed4e5cc63`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:23.606124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:23.732508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 806/1621] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:23 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:23.735956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe2330-0ed6-4bf8-9d83-73444b15b995 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:23.736921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe2330-0ed6-4bf8-9d83-73444b15b995 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:23.737417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe2330-0ed6-4bf8-9d83-73444b15b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:23.789330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-debe2330-0ed6-4bf8-9d83-73444b15b995 None None] MFA Rules not processed for user `c023f89fd3da4bc8b38963bed4e5cc63`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:23.791341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-debe2330-0ed6-4bf8-9d83-73444b15b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:23.809767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 816/1622] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:23 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:24.190654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:24.192711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:24.418544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c70913-da70-4998-b405-7dd33bb26952 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:24.427012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:24.427295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:24.427584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:24.428049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:24.437736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:24.439375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c668c5c-9d38-44f5-b392-4c0371152cad service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:24.450965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 807/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:24 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:25.153428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fbbf-2b99-4b01-b417-b75f763570c4 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.154005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fbbf-2b99-4b01-b417-b75f763570c4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.154239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fbbf-2b99-4b01-b417-b75f763570c4 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.156205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 817/1624] 10.222.0.60 () {54 vars in 960 bytes} [Tue Nov 23 12:59:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:25.163225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef56fa-5ba2-4c8b-942c-8f2962eca5b5 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.163600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef56fa-5ba2-4c8b-942c-8f2962eca5b5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.163945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef56fa-5ba2-4c8b-942c-8f2962eca5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.214883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-82ef56fa-5ba2-4c8b-942c-8f2962eca5b5 None None] MFA Rules not processed for user `330a0223f48d4b03bc84c07e34ec62a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:25.218986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-82ef56fa-5ba2-4c8b-942c-8f2962eca5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:25.352165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 808/1625] 10.222.0.60 () {58 vars in 1057 bytes} [Tue Nov 23 12:59:25 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:25.357605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743fbbf-2b99-4b01-b417-b75f763570c4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:25.387949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743fbbf-2b99-4b01-b417-b75f763570c4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:25.395642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:25.397896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.398494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.399308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.401606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:25.434148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:25.440431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c8cb-dc78-4c0f-bf5e-84406bd01665 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:25.461102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 818/1626] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:25 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:25.673927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.674626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.674626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.676934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 809/1627] 10.222.0.60 () {54 vars in 912 bytes} [Tue Nov 23 12:59:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:25.685940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.686252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.686568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.755082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:25.759109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:25.773620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:25.774835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:25.801310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 819/1628] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:59:25 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:25.803771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea4cb-e39d-45db-9426-5fb6d6a9658f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:25.835834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:25.837171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:25.838177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:25.838666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] PATH_INFO: `/v3/projects/a292a89d27674cf4adad86f87af6e648` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:25.840883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a292a89d27674cf4adad86f87af6e648)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:25.843940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: WARNING py.warnings [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:25.843940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: warnings.warn(msg) Nov 23 12:59:25.843940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: Nov 23 12:59:25.856379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:25.973628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:25.990004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae39d0-15d8-4c7a-9548-eb52c37639fa None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:26.001593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:26.002685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.002685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.002839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.027817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:26.029352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:26.045441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 820/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:25 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:26.047758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:26.050368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:26.070846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a292a89d27674cf4adad86f87af6e648', 'request_id': 'req-af36a54e-6e97-406f-9c7c-215beb5381d1'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:26.093903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a292a89d27674cf4adad86f87af6e648', 'request_id': 'req-af36a54e-6e97-406f-9c7c-215beb5381d1'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:26.098926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca241-db98-4ba5-9d93-a6ee671fbe1e service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:26.129313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a292a89d27674cf4adad86f87af6e648', 'request_id': 'req-af36a54e-6e97-406f-9c7c-215beb5381d1'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:26.159127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] The token cache is being invalidate because project a292a89d27674cf4adad86f87af6e648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:26.171547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:26.175258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-af36a54e-6e97-406f-9c7c-215beb5381d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:26.182507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 810/1630] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:25 2021] DELETE /identity/v3/projects/a292a89d27674cf4adad86f87af6e648 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:26.189278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab43a4-5bbb-4bb1-a74d-de8ad1add0e0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.189820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab43a4-5bbb-4bb1-a74d-de8ad1add0e0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.190303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab43a4-5bbb-4bb1-a74d-de8ad1add0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.227986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-39ab43a4-5bbb-4bb1-a74d-de8ad1add0e0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:26.229839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-39ab43a4-5bbb-4bb1-a74d-de8ad1add0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:26.296345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:26.298060 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.298346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.298623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.312699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:26.366554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:26.373639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:26.380686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 811/1631] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:26.388222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.390334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.390795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.411364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 821/1632] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:26.477866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:26.481771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:26.508503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 812/1633] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:26.510789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:26.532294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8d35c-5749-4a1b-88b8-51964ebd48c3 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:26.555435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:26.556772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.556772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.573084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.574069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:26.574514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:26.578197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:26.612895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 822/1634] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:26.615415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:26.625732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328aaa3-3d9f-4dc9-8553-c6de9ec163e4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:26.655717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:26.670579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:26.681354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:26.684887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:26.686037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:26.691873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:26.849566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:26.861355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 813/1635] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:26 2021] POST /identity/v3/projects => generated 403 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:26.871174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6d167-d590-473a-a323-30982f58c872 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:27.091120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:27.091650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.091934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.092212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.092896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:27.094859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:27.140608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 823/1636] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:26 2021] POST /identity/v3/users => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 12:59:27.145085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:27.164870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5116e-6c37-4098-b849-484c2f0c3d60 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:27.184119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:27.185869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.186605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.187096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.188030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:27.190386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:27.209825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 814/1637] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:27 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:27.213696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:27.230736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3e1-5c39-4488-9d7f-bdb0f8900c71 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:27.249716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:27.250341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.250625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.250894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.254421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:27.256459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886df0b-2e45-43d3-9d08-b572055d79c0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:27.294683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:27.307943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796537db-6c48-49c9-ae62-6f92c103aad2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:27.308962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 824/1638] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:27 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:27.330962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:27.331804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.332083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.332395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] PATH_INFO: `/v3/projects/0f2f5f992c4f4db9806dda512f520ed8/users/c8be254bef0f4ae980de9803cdb2851d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.647334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2f5f992c4f4db9806dda512f520ed8, user_id=c8be254bef0f4ae980de9803cdb2851d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:27.651185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c799b4e-e9c8-4bc6-b567-0347cb13f56a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:27.675349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 815/1639] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:27 2021] PUT /identity/v3/projects/0f2f5f992c4f4db9806dda512f520ed8/users/c8be254bef0f4ae980de9803cdb2851d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:27.694280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.694877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.695309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.734542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:27.735160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:27.735327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:27.775772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] MFA Rules not processed for user `4540fb62ff264ba4929a567b548de846`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:27.777010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:27.811900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] MFA Rules not processed for user `c8be254bef0f4ae980de9803cdb2851d`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:27.813287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:27.951824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 825/1640] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:27 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:28.037788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 816/1641] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:27 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:28.044031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.107692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.109094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:28.186844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0d79-154e-41c7-9ae6-eb78e8b1a1ea None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.192069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.192700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.192985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.193265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.193925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.195922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.228916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232bee-3374-4303-8edf-09cc6d741fa7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.236646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.237262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.237397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 826/1642] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:28 2021] POST /identity/v3/projects => generated 405 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:28.237595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.237878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.238757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.241202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:28.250258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.252076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.266515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 817/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:28 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:28.268145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.294208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd235-8557-4828-b4d8-563d805b7fe9 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.421650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adcb9b-50a3-4f46-b33e-142e90932cdf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.432699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.433593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.433883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.434212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] PATH_INFO: `/v3/users/77fd0e2694434d88be9ab3153f881a15` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.437056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fd0e2694434d88be9ab3153f881a15)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.439077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.451262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.452436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.452933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.453470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.454753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.458907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.509502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 818/1644] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:28 2021] POST /identity/v3/users => generated 309 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:28.513851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.529337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb00bb3-7b65-4e61-a88e-6703fa5145f4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.540878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.541755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.542137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.543370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.544182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.545915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.556752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fd0e2694434d88be9ab3153f881a15'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:28.563314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 819/1645] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:28.568385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.570547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fd0e2694434d88be9ab3153f881a15'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:28.584369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fd0e2694434d88be9ab3153f881a15'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:28.585474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fd0e2694434d88be9ab3153f881a15'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:28.586298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8c11592b-6532-4c76-b8dc-3d33493d5b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fd0e2694434d88be9ab3153f881a15'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:28.590966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d84c-0cf4-40ec-99f7-60b8d0ac74aa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.599063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.599950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.600328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.600707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] PATH_INFO: `/v3/projects/19bc684c7e624eb7836ac511ef97a821/users/38dfac20a4c9429ab39eb02e46cf94f5/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.602130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 827/1646] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:28 2021] DELETE /identity/v3/users/77fd0e2694434d88be9ab3153f881a15 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:28.610091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.610562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.610939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.632552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bc684c7e624eb7836ac511ef97a821, user_id=38dfac20a4c9429ab39eb02e46cf94f5, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.636709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.681520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 820/1647] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:28 2021] PUT /identity/v3/projects/19bc684c7e624eb7836ac511ef97a821/users/38dfac20a4c9429ab39eb02e46cf94f5/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:28.685666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.687316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:28.693536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:28.694179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:28.941861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 828/1648] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:28.949250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b78a0c-d576-4d3a-a38f-d9471bcdbde5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:28.959777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:28.960677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:28.961069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:28.961451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:28.962316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:28.968825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:28.982154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:28.983675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:29.004955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 821/1649] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:29.021111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:29.068636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e26-22fb-49ef-a43d-9fc3cea2daf0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:29.086512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:29.087558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:29.087949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:29.088364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] PATH_INFO: `/v3/projects/19bc684c7e624eb7836ac511ef97a821/users/38dfac20a4c9429ab39eb02e46cf94f5/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:29.093978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bc684c7e624eb7836ac511ef97a821, user_id=38dfac20a4c9429ab39eb02e46cf94f5, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:29.097817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440aa5e4-e0da-4133-856c-f2090e7e684e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:29.136452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 822/1650] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:29 2021] PUT /identity/v3/projects/19bc684c7e624eb7836ac511ef97a821/users/38dfac20a4c9429ab39eb02e46cf94f5/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:29.138144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:29.140565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:29.141428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:29.185386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d40b70-e42b-42e9-ae34-44678e7e52a3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:29.221941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] MFA Rules not processed for user `38dfac20a4c9429ab39eb02e46cf94f5`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:29.228529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:29.314099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:29.314861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:29.315283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:29.315666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:29.422104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 823/1651] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:29 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:29.428408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:29.430152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:29.503246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:29.505564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:29.518304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 829/1652] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:29.565114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de0f90-be32-4121-ad8d-01f77bd84b04 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:29.569198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:29.570050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:29.570588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:29.571085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:29.582705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:29.584548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87571759-171d-41ba-a43a-29102c283d04 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:29.595347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 824/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:29 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:29.923607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:29.933213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331cfe8-8060-493e-9716-ebc3ad471fd6 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:29.954094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:29.954916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:29.955200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:29.955482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] PATH_INFO: `/v3/users/c8be254bef0f4ae980de9803cdb2851d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:29.959290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8be254bef0f4ae980de9803cdb2851d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:29.961307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:30.080471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8be254bef0f4ae980de9803cdb2851d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:30.097097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8be254bef0f4ae980de9803cdb2851d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:30.122743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8be254bef0f4ae980de9803cdb2851d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:30.128889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8be254bef0f4ae980de9803cdb2851d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:30.131432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8be254bef0f4ae980de9803cdb2851d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:30.164924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 830/1654] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:29 2021] DELETE /identity/v3/users/c8be254bef0f4ae980de9803cdb2851d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:30.169842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:30.170318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:30.170453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:30.233991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:30.236591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:30.410591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 825/1655] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:30.477504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:30.480539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:30.656625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b3b4-3ef2-446f-a938-c66e38bad5db admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:30.662303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:30.663398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:30.663696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:30.664024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:30.675665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:30.678130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:30.692809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 831/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:31.117797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:31.119861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:31.146922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676aac-cd71-4426-9d0a-034c1dd35731 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:31.158509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:31.162016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:31.162733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:31.163067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] PATH_INFO: `/v3/projects/a2f9123ebba5429d822532e9bd32d324` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:31.165406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f9123ebba5429d822532e9bd32d324)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:31.173211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:31.245096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f9123ebba5429d822532e9bd32d324', 'request_id': 'req-640d483c-ddab-410b-bd1d-71bd1b3d52c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.266098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f9123ebba5429d822532e9bd32d324', 'request_id': 'req-640d483c-ddab-410b-bd1d-71bd1b3d52c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.298960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f9123ebba5429d822532e9bd32d324', 'request_id': 'req-640d483c-ddab-410b-bd1d-71bd1b3d52c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.325791 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] The token cache is being invalidate because project a2f9123ebba5429d822532e9bd32d324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:31.326229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.327392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.334154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 826/1657] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:31 2021] DELETE /identity/v3/projects/a2f9123ebba5429d822532e9bd32d324 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:31.338459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:31.352045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910cba-0db2-4aa0-bc96-4d1aab5797d5 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:31.447588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:31.448752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:31.449210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:31.449668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] PATH_INFO: `/v3/users/0694ed6645264163ba4c389b0adfcf60` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:31.451141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0694ed6645264163ba4c389b0adfcf60)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:31.453994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:31.528080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0694ed6645264163ba4c389b0adfcf60'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.542261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0694ed6645264163ba4c389b0adfcf60'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.588001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0694ed6645264163ba4c389b0adfcf60'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.590591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0694ed6645264163ba4c389b0adfcf60'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.591380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0694ed6645264163ba4c389b0adfcf60'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:31.638997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 832/1658] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:31 2021] DELETE /identity/v3/users/0694ed6645264163ba4c389b0adfcf60 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:32.269516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:32.269516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:32.269516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d483c-ddab-410b-bd1d-71bd1b3d52c4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:32.462056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:32.463547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:32.464018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:32.464483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] PATH_INFO: `/v3/projects/0f2f5f992c4f4db9806dda512f520ed8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:32.473846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2f5f992c4f4db9806dda512f520ed8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:32.475955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:32.578882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2f5f992c4f4db9806dda512f520ed8', 'request_id': 'req-4c8cd834-21a9-4d0e-838f-2b566be89cad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:32.601466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2f5f992c4f4db9806dda512f520ed8', 'request_id': 'req-4c8cd834-21a9-4d0e-838f-2b566be89cad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:32.623683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2f5f992c4f4db9806dda512f520ed8', 'request_id': 'req-4c8cd834-21a9-4d0e-838f-2b566be89cad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:32.653889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] The token cache is being invalidate because project 0f2f5f992c4f4db9806dda512f520ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:32.654197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:32.654984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4c8cd834-21a9-4d0e-838f-2b566be89cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:32.657026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 827/1659] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:32 2021] DELETE /identity/v3/projects/0f2f5f992c4f4db9806dda512f520ed8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:32.665567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:32.669322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:32.729093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819462-fc12-4f96-ba7c-ebf00b1f7c50 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:32.894739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:32.895556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:32.895842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:32.897142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] PATH_INFO: `/v3/users/38dfac20a4c9429ab39eb02e46cf94f5` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:32.898342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dfac20a4c9429ab39eb02e46cf94f5)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:32.901022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:33.001702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dfac20a4c9429ab39eb02e46cf94f5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.024497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dfac20a4c9429ab39eb02e46cf94f5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.046293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dfac20a4c9429ab39eb02e46cf94f5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.047422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dfac20a4c9429ab39eb02e46cf94f5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.048360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dfac20a4c9429ab39eb02e46cf94f5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.068922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 833/1660] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:32 2021] DELETE /identity/v3/users/38dfac20a4c9429ab39eb02e46cf94f5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:33.179321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47e7d-fc58-4e23-992b-88914f03c47b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:33.179614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47e7d-fc58-4e23-992b-88914f03c47b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:33.179899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47e7d-fc58-4e23-992b-88914f03c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:33.218148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8db47e7d-fc58-4e23-992b-88914f03c47b None None] MFA Rules not processed for user `4540fb62ff264ba4929a567b548de846`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:33.228792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8db47e7d-fc58-4e23-992b-88914f03c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:33.312829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 828/1661] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:33 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:33.589550 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:33.591138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:33.690019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af551-84db-4ea9-a781-52d16eefe554 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:33.695436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:33.696511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:33.697061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:33.697528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] PATH_INFO: `/v3/projects/57191111351f4f5f84a8cd0f6c801225` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:33.698814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57191111351f4f5f84a8cd0f6c801225)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:33.700878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:33.767651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57191111351f4f5f84a8cd0f6c801225', 'request_id': 'req-99f7092b-4e3c-4fe5-abff-7251b4b8901f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.793406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57191111351f4f5f84a8cd0f6c801225', 'request_id': 'req-99f7092b-4e3c-4fe5-abff-7251b4b8901f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.959022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57191111351f4f5f84a8cd0f6c801225', 'request_id': 'req-99f7092b-4e3c-4fe5-abff-7251b4b8901f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.971708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] The token cache is being invalidate because project 57191111351f4f5f84a8cd0f6c801225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:33.972209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.973059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-99f7092b-4e3c-4fe5-abff-7251b4b8901f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:33.978970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 834/1662] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:33 2021] DELETE /identity/v3/projects/57191111351f4f5f84a8cd0f6c801225 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:33.980690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa52e41-bce1-46f2-b2b1-cb81dbfab54f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:33.980978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa52e41-bce1-46f2-b2b1-cb81dbfab54f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:33.981263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa52e41-bce1-46f2-b2b1-cb81dbfab54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.011111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4aa52e41-bce1-46f2-b2b1-cb81dbfab54f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:34.012607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4aa52e41-bce1-46f2-b2b1-cb81dbfab54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.061091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709282-6a23-42c7-91cf-2a25769e8582 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.061377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709282-6a23-42c7-91cf-2a25769e8582 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.062899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709282-6a23-42c7-91cf-2a25769e8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.117546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-53709282-6a23-42c7-91cf-2a25769e8582 None None] MFA Rules not processed for user `9285e1edf7ed42029c54bcc4f86abda7`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:34.119001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-53709282-6a23-42c7-91cf-2a25769e8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.200952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 829/1663] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:34.255435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.255779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.256062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.265108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 835/1664] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:34 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:34.288352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.288629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.288907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.290025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:34.291905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.314174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 830/1665] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:34.329461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:34.334299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.340088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] MFA Rules not processed for user `9285e1edf7ed42029c54bcc4f86abda7`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:34.341270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.348130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c3f0-41de-4bc0-bccd-bd11f8e166a5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:34.355263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:34.356369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.356758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.357136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] PATH_INFO: `/v3/projects/19bc684c7e624eb7836ac511ef97a821` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.358774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bc684c7e624eb7836ac511ef97a821)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:34.361377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:34.362964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 836/1666] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:34 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:34.363950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:34.388834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6148d-566a-4566-af29-8639b53fa910 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:34.401022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:34.401817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.401956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.402217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.402967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:34.403269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:34.405160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:34.445447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 837/1667] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:34.446352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:34.448708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.494084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bc684c7e624eb7836ac511ef97a821', 'request_id': 'req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:34.516975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bc684c7e624eb7836ac511ef97a821', 'request_id': 'req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:34.539305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bc684c7e624eb7836ac511ef97a821', 'request_id': 'req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:34.559818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] The token cache is being invalidate because project 19bc684c7e624eb7836ac511ef97a821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:34.560096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:34.564691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:34.566303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 831/1668] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:34 2021] DELETE /identity/v3/projects/19bc684c7e624eb7836ac511ef97a821 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:34.567131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:34.568465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.683967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121b0b-e3ae-44e1-845a-407e6cc3de8f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:34.697753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:34.698560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.698848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.699125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.699773 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:34.707741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7faa651-bef9-4517-a861-c584c714fb0b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:34.726072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e06d9-e405-4bb4-b096-dfa32334a7d4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:34.788438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 832/1669] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:34 2021] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:34.790086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.790501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.792254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.867061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:34.868283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:34.972557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:34.973487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:34.973799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:34.974082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:34.987917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:35.084441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 833/1670] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:35.092445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.095658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.097785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c8b20-d365-4f9b-9b66-3a55f4c38316 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.110510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 838/1671] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:34 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:35.112581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.113157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.114698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.143798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0699-daea-4788-9fcb-4b9f2c3402a7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.161380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.162184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.162475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.162756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.163478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.163901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:35.165350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:35.166743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.202557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 839/1672] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:35.207761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.219841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5841-f6fe-460d-be57-83fb834c4c17 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.225757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.228198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.228729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.229179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.230478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:35.230978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.233392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.251992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 834/1673] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:35 2021] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:35.256957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.268899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 840/1674] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:35.269913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.285724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8e864-84fb-43e4-a98c-a838d6b6039c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.294121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f08b0-1947-495e-8c6f-358ef082a285 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.297692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.298921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.300967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.301603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.302998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.307691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.308967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.311127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.311638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.312636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.315076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.318124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.379429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 835/1675] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:35 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:35.383761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.418144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5702-989b-4e8a-aae5-2b8dea71150b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.421855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 841/1676] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:35 2021] POST /identity/v3/projects => generated 357 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:35.427075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.442694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.443418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.443711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.443992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.444749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.459350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.482612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 836/1677] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:35 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:35.494789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:35.526570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042674-efa5-45ef-bdb9-2f7b8c2deede admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.672495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d64f0-cfd3-4bbc-853f-167fea393510 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:35.684571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.685350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.685640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.685927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.688156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.691533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2836d-1775-478a-b282-1109a7d4dc0a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.741918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:35.743959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.744272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.749445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] PATH_INFO: `/v3/projects/6982769218f14793ae2533d277d34b25/users/f0c088daafe344a699876155e832549f/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.749747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 842/1678] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:35 2021] POST /identity/v3/users => generated 279 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:35.751631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0330e7-34c1-42d1-9416-3a026373fd2d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:35.751929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0330e7-34c1-42d1-9416-3a026373fd2d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:35.752210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0330e7-34c1-42d1-9416-3a026373fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:35.799511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6982769218f14793ae2533d277d34b25, user_id=f0c088daafe344a699876155e832549f, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:35.807948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:35.811875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ec0330e7-34c1-42d1-9416-3a026373fd2d None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:35.813076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ec0330e7-34c1-42d1-9416-3a026373fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:35.849027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 837/1679] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:35 2021] PUT /identity/v3/projects/6982769218f14793ae2533d277d34b25/users/f0c088daafe344a699876155e832549f/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:35.850502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.028849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dda67f-3151-4e9c-9337-221fb3001bc8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.036952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 843/1680] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 12:59:35 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:36.039886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.041205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.041536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.045703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.046306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.047731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.049861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.050605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.053632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:36.077125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 838/1681] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:35 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:36.084542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.097637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d738-1dcb-487c-a35d-ecfcc6ff59ec admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.110966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.111756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.112052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.112566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.113440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.115408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:36.139025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 839/1682] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:36 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:36.140125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.151789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb602ca-9432-4214-93e8-820546a2e2c6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.157411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.158258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.158583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.158903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] PATH_INFO: `/v3/projects/8b41e4a65cbd402490258f2ee42f0eb4/users/46cfb2b0e80642a7b6476c758a8e604f/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.189104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b41e4a65cbd402490258f2ee42f0eb4, user_id=46cfb2b0e80642a7b6476c758a8e604f, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.192499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] MFA Rules not processed for user `f0c088daafe344a699876155e832549f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:36.197036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:36.197210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a5e9a-1c01-4dc5-8e44-6da9b46b479c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:36.228397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 840/1683] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:36 2021] PUT /identity/v3/projects/8b41e4a65cbd402490258f2ee42f0eb4/users/46cfb2b0e80642a7b6476c758a8e604f/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:36.239624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609465-df85-4601-b047-040130807f35 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.240355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609465-df85-4601-b047-040130807f35 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.241388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609465-df85-4601-b047-040130807f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.336494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 844/1684] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:36 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:36.341327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.343516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:36.367196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-49609465-df85-4601-b047-040130807f35 None None] MFA Rules not processed for user `46cfb2b0e80642a7b6476c758a8e604f`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:36.372176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-49609465-df85-4601-b047-040130807f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:36.472880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2029a-6708-4764-85a2-2efea3235c9e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.599918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 841/1685] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:36 2021] POST /identity/v3/auth/tokens => generated 3664 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:36.599918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609465-df85-4601-b047-040130807f35 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.622794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.623410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.623702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.623984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.773956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609465-df85-4601-b047-040130807f35 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.783374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.789375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:36.792437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.793156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.793506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.793867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.794574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.796855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:36.802402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 845/1686] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 12:59:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:36.803469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.874706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42b8e-e941-4bae-8a08-0c6e1f6c1ebe service swift] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:36.898002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 842/1687] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:36 2021] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:36.900337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:36.907099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:36.914597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:36.916655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:36.917074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:36.923935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:36.930307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.069382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 846/1688] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:36 2021] POST /identity/v3/projects => generated 355 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:37.072016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.125115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda8265-b907-406b-9bdc-645644417c94 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.358770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.361581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.365664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.365664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.366395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.374985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.377371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced625e-ddff-413c-8504-3b3a9f0f2a75 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.391057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.391846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.397048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.397048 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.397993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.406013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.457807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 843/1689] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:36 2021] POST /identity/v3/users => generated 297 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:37.469121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.474716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 847/1690] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:37 2021] POST /identity/v3/users => generated 284 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:37.476065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.500103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f46cd-65f5-449b-aea3-3c0f36123e59 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.525513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.526208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda63936-2670-43f6-adb0-5bf1b279cbb5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.526952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.530405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.533530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.534421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.538025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.547249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.553807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.555303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.555635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.560879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.569588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 848/1691] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:37.573538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.574651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.610007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d527-05ab-4ae6-bd15-c2dee376380e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.623021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 844/1692] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:37.632549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.636625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.637592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.637978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.638357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] PATH_INFO: `/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d/users/2fdc2231aa48497590eda27f380d1030/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.667464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866faa7c-f36d-4da1-ba59-94e518ce27ef admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.687453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.689693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.690639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.691062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] PATH_INFO: `/v3/projects/aba08a6767d04d8c9e736f6039e67370/users/139c775e8bb54547bdfcf8ece33ad3b7/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.703317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676067f946f4a9e84b4e8e3b397cc5d, user_id=2fdc2231aa48497590eda27f380d1030, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.715670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.731651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba08a6767d04d8c9e736f6039e67370, user_id=139c775e8bb54547bdfcf8ece33ad3b7, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.736516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:37.764299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 845/1693] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:37 2021] PUT /identity/v3/projects/aba08a6767d04d8c9e736f6039e67370/users/139c775e8bb54547bdfcf8ece33ad3b7/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:37.768154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.778977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 849/1694] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:37 2021] PUT /identity/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d/users/2fdc2231aa48497590eda27f380d1030/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:37.787008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:37.965522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5d85-d3bd-41ec-9353-647aee0b0581 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:37.978088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:37.979788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:37.980582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:37.982179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:37.983092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:37.985992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.020567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 846/1695] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:38.024739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.076687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd16b67-4557-4eab-9574-911a0de54457 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.081563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c059-ca26-42e0-991b-0618d6fe1d31 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.094888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.098288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.099047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.099159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.099425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.099712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.099815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] PATH_INFO: `/v3/projects/aba08a6767d04d8c9e736f6039e67370/users/139c775e8bb54547bdfcf8ece33ad3b7/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.100187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.101101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:38.111776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.111975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba08a6767d04d8c9e736f6039e67370, user_id=139c775e8bb54547bdfcf8ece33ad3b7, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:38.122689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd706-14d5-4e4e-a4c5-5924cb93cc0b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.149128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 850/1696] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:37 2021] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:38.156064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.184913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 847/1697] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:38 2021] PUT /identity/v3/projects/aba08a6767d04d8c9e736f6039e67370/users/139c775e8bb54547bdfcf8ece33ad3b7/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:38.190678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34219f4-fd86-451c-9b6c-17784f5efbaf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.197310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb6cf-497a-4705-8adf-70e7e8fc9eb9 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.197650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb6cf-497a-4705-8adf-70e7e8fc9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.197987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb6cf-497a-4705-8adf-70e7e8fc9eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.250844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-086eb6cf-497a-4705-8adf-70e7e8fc9eb9 None None] MFA Rules not processed for user `139c775e8bb54547bdfcf8ece33ad3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:38.252331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-086eb6cf-497a-4705-8adf-70e7e8fc9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.390470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.391440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.391809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.392201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] PATH_INFO: `/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d/users/2fdc2231aa48497590eda27f380d1030/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.394487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676067f946f4a9e84b4e8e3b397cc5d, user_id=2fdc2231aa48497590eda27f380d1030, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:38.397605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ec8c-3332-49d2-960b-23d7cdeb5c4e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.427276 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 851/1698] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:38 2021] PUT /identity/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d/users/2fdc2231aa48497590eda27f380d1030/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:38.428799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.429199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.429584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.431408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 848/1699] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:38 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:38.444757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.445054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.445337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.488556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:38.492642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.565718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] MFA Rules not processed for user `2fdc2231aa48497590eda27f380d1030`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:38.566925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.638098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 852/1700] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Nov 23 12:59:38 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:38.639335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.642269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.718770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 849/1701] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:38 2021] POST /identity/v3/auth/tokens => generated 3729 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:38.719802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.734872 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.748930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a9ec6-13e6-41cd-a138-e98c70c3be06 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.753113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.753753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.754058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.754328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.770390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:38.771916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.781802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 850/1702] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:38 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:38.782902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.784208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:38.792127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796647-4827-4b51-95a6-263d56e81f4e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.796865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdafc5-8801-4c8f-8515-aa007ae8905b service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:38.800805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.801394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.801681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.801960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.812537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:38.814139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:38.825070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 851/1703] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:38 2021] GET /identity/v3/auth/tokens => generated 3729 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:38.835094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:38.835704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:38.835995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:38.836331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:38.982998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:38.992521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2624bd9-5d23-4916-a70b-6a2c3405dc38 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:39.006097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:39.007093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:39.007517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:39.007907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:39.022659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:39.024321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:39.044935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 853/1704] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:38 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:39.197305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:39.198756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:39.228715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 852/1705] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:38 2021] GET /identity/v3/auth/tokens => generated 3664 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:40.195377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:40.210522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20582d7-c918-49b5-9d6d-bb10d4a5b2c5 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:40.237518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139c775e8bb54547bdfcf8ece33ad3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba08a6767d04d8c9e736f6039e67370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:40.238854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:40.240593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:40.242363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:40.245043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:40.245935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:40.257059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:40.304614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 854/1706] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:40.306356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:40.325216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23d9-2c0f-477a-9ff8-ca8b7baf70b3 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:40.341809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139c775e8bb54547bdfcf8ece33ad3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba08a6767d04d8c9e736f6039e67370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:40.342513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:40.342850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:40.343138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:40.343865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:40.346184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c418b3d-d678-428f-abb6-d89665e2ea1c tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:40.424003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 853/1707] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:40 2021] POST /identity/v3/projects => generated 355 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:40.424435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:40.446732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367440d-f293-4705-a5da-a057d54c2c68 tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:40.591652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:40.592005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:40.592382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:40.666054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139c775e8bb54547bdfcf8ece33ad3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba08a6767d04d8c9e736f6039e67370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:40.667134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:40.667492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:40.667773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:40.667868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] MFA Rules not processed for user `9285e1edf7ed42029c54bcc4f86abda7`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:40.668538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:40.668854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:40.670579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:40.672001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:40.707224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 855/1708] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:40.858565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:40.860773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:40.898189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 854/1709] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:40 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:40.899251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:40.925087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dd378-0048-4781-a60f-bfc3832bdbbb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:40.949883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139c775e8bb54547bdfcf8ece33ad3b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aba08a6767d04d8c9e736f6039e67370', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:40.950772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:40.952217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:40.952569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] PATH_INFO: `/v3/projects/581aa850ede641d0a4610897f64c59e1` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:40.960124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorizing `identity:delete_project(project_id=581aa850ede641d0a4610897f64c59e1)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:40.965947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:41.092088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a2c9-3d27-43e7-99b0-7bc1d458f91b tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:41.116507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581aa850ede641d0a4610897f64c59e1', 'request_id': 'req-c9f98540-2c70-4fc3-aa35-dd8820f23acf'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.134984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581aa850ede641d0a4610897f64c59e1', 'request_id': 'req-c9f98540-2c70-4fc3-aa35-dd8820f23acf'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.158229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581aa850ede641d0a4610897f64c59e1', 'request_id': 'req-c9f98540-2c70-4fc3-aa35-dd8820f23acf'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.184761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] The token cache is being invalidate because project 581aa850ede641d0a4610897f64c59e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:41.185126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.185716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c9f98540-2c70-4fc3-aa35-dd8820f23acf tempest-VolumeQuotaClassesTest-1738725715 tempest-VolumeQuotaClassesTest-1738725715-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.187258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 855/1710] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:40 2021] DELETE /identity/v3/projects/581aa850ede641d0a4610897f64c59e1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:41.331030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:41.333264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:41.335491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:41.336844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] PATH_INFO: `/v3/users/a4d943e4e5b547cfbe2dc0b3c53d189a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:41.341160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d943e4e5b547cfbe2dc0b3c53d189a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:41.348761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:41.535707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d943e4e5b547cfbe2dc0b3c53d189a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.561094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d943e4e5b547cfbe2dc0b3c53d189a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.610041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d943e4e5b547cfbe2dc0b3c53d189a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.611109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d943e4e5b547cfbe2dc0b3c53d189a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.612841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d943e4e5b547cfbe2dc0b3c53d189a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:41.656286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 856/1711] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:40 2021] DELETE /identity/v3/users/a4d943e4e5b547cfbe2dc0b3c53d189a => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:41.661016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:41.661543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:41.661882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:41.709172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:41.715723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:42.029589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 856/1712] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:42.153478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:42.154972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:42.167838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:42.169250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:42.190418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb5b1-8c8e-4923-99a6-cebf0681e3cf None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:42.208421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:42.214181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:42.214545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:42.214839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] PATH_INFO: `/v3/users/f0c088daafe344a699876155e832549f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:42.224296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c088daafe344a699876155e832549f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:42.226618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:42.339977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c088daafe344a699876155e832549f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:42.353600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45548e7-3116-4fe8-963f-85e2f3daa411 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:42.355684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c088daafe344a699876155e832549f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:42.357061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:42.357663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:42.357959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:42.358223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:42.378834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:42.389108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529fea7-eb46-412f-9d22-4abeec03f917 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:42.390349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c088daafe344a699876155e832549f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:42.392332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c088daafe344a699876155e832549f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:42.393402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c088daafe344a699876155e832549f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:42.411224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 857/1713] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:42.434611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 857/1714] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:42 2021] DELETE /identity/v3/users/f0c088daafe344a699876155e832549f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:42.435475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06b215-ff28-4a1d-8567-7b705a1f6496 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:42.435757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06b215-ff28-4a1d-8567-7b705a1f6496 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:42.436034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06b215-ff28-4a1d-8567-7b705a1f6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:42.501258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ef06b215-ff28-4a1d-8567-7b705a1f6496 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:42.504351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ef06b215-ff28-4a1d-8567-7b705a1f6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:42.801213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 858/1715] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:43.056744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:43.059106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:43.077689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032296f-bff1-4677-80a8-799bc8d2f8ed None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:43.078205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032296f-bff1-4677-80a8-799bc8d2f8ed None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:43.078356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032296f-bff1-4677-80a8-799bc8d2f8ed None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:43.080857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 859/1716] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:59:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:43.204426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:43.204881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:43.205232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:43.263518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:43.269037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:43.337480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42067-778f-4a50-98ea-7748585d167b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:43.350613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:43.357721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:43.358035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:43.358510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:43.393580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:43.402707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:43.435499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 858/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:43.497712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 860/1718] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:59:43 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:44.642018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:44.644971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:44.736749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fcc3-644a-4845-bb4f-639d1f542c63 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:44.791596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:44.794429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:44.794429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:44.794429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:44.874970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:44.889848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:44.936446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 859/1719] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:44 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:47.496606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:47.499189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:47.529532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3f0e-de9f-4ad3-b7d1-50bd671bd89d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:47.540719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:47.543079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:47.543529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:47.544525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] PATH_INFO: `/v3/projects/6982769218f14793ae2533d277d34b25` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:47.548858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6982769218f14793ae2533d277d34b25)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:47.552358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:47.667273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6982769218f14793ae2533d277d34b25', 'request_id': 'req-02adc832-94b3-4d64-987e-7d2af6521ebd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:47.679607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6982769218f14793ae2533d277d34b25', 'request_id': 'req-02adc832-94b3-4d64-987e-7d2af6521ebd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:47.719597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6982769218f14793ae2533d277d34b25', 'request_id': 'req-02adc832-94b3-4d64-987e-7d2af6521ebd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:47.734962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] The token cache is being invalidate because project 6982769218f14793ae2533d277d34b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:47.735583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:47.736994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:47.742284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 861/1720] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:47 2021] DELETE /identity/v3/projects/6982769218f14793ae2533d277d34b25 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:47.743417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:47.763168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812078-b3fa-4fc5-91cb-54ff7943ca3d service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:47.910437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:47.911544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:47.912143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:47.912583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] PATH_INFO: `/v3/users/139c775e8bb54547bdfcf8ece33ad3b7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:47.913996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139c775e8bb54547bdfcf8ece33ad3b7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:47.919581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:48.004646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139c775e8bb54547bdfcf8ece33ad3b7'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.014656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139c775e8bb54547bdfcf8ece33ad3b7'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.029755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139c775e8bb54547bdfcf8ece33ad3b7'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.030477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139c775e8bb54547bdfcf8ece33ad3b7'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.031065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a8bf9410-89e8-4c52-84b9-97341c55a322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139c775e8bb54547bdfcf8ece33ad3b7'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.047111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 860/1721] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:47 2021] DELETE /identity/v3/users/139c775e8bb54547bdfcf8ece33ad3b7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:48.241152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:48.242589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:48.263203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc832-94b3-4d64-987e-7d2af6521ebd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:48.418647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:48.420365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:48.421089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:48.421901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] PATH_INFO: `/v3/projects/0fa722c7481547ba84a53135a4716aec` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:48.426278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa722c7481547ba84a53135a4716aec)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:48.430382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:48.541863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa722c7481547ba84a53135a4716aec', 'request_id': 'req-fffc6b3f-61e8-4932-aec5-541657f34b8c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.563790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa722c7481547ba84a53135a4716aec', 'request_id': 'req-fffc6b3f-61e8-4932-aec5-541657f34b8c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.584486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa722c7481547ba84a53135a4716aec', 'request_id': 'req-fffc6b3f-61e8-4932-aec5-541657f34b8c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.591140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c39a88-3357-4d2c-a32d-78f5f3fd0cbe None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:48.591577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c39a88-3357-4d2c-a32d-78f5f3fd0cbe None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:48.591862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c39a88-3357-4d2c-a32d-78f5f3fd0cbe None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:48.595632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 861/1722] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 12:59:48 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 12:59:48.606462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] The token cache is being invalidate because project 0fa722c7481547ba84a53135a4716aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:48.606814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.607618 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-fffc6b3f-61e8-4932-aec5-541657f34b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:48.610468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 862/1723] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:48 2021] DELETE /identity/v3/projects/0fa722c7481547ba84a53135a4716aec => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:48.615881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:48.618414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:48.619140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:48.633838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470fa5-5680-4ce7-9eb9-90619ad4c016 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:48.634143 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470fa5-5680-4ce7-9eb9-90619ad4c016 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:48.634423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470fa5-5680-4ce7-9eb9-90619ad4c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:48.672383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:48.677198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:48.703549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d5470fa5-5680-4ce7-9eb9-90619ad4c016 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:48.706770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d5470fa5-5680-4ce7-9eb9-90619ad4c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:48.964459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 862/1724] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:48.964459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:48.969880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.018985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ec2c-565d-4354-9b6a-4f6a3c8fd2af None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.022067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 863/1725] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 12:59:48 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:49.023484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.023782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.024066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.033399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.035699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.037176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.037475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] PATH_INFO: `/v3/projects/aba08a6767d04d8c9e736f6039e67370` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.040562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba08a6767d04d8c9e736f6039e67370)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.047068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.076932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:49.078087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.107207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 864/1726] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:49.111083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.124365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b6148-59ef-466a-bfe1-965ecf4472fc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.138250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.138872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.139161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.139438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.140319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:49.140629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.142260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.193108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 865/1727] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:49.194162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.215024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f501253-e5f8-4f40-8863-d8f3aa569d45 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.223862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba08a6767d04d8c9e736f6039e67370', 'request_id': 'req-30a3a4d5-69b2-462a-9a59-791c2f443cd6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:49.249328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba08a6767d04d8c9e736f6039e67370', 'request_id': 'req-30a3a4d5-69b2-462a-9a59-791c2f443cd6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:49.270009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba08a6767d04d8c9e736f6039e67370', 'request_id': 'req-30a3a4d5-69b2-462a-9a59-791c2f443cd6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:49.300876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] The token cache is being invalidate because project aba08a6767d04d8c9e736f6039e67370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:49.301275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:49.303180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-30a3a4d5-69b2-462a-9a59-791c2f443cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:49.307300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 863/1728] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:48 2021] DELETE /identity/v3/projects/aba08a6767d04d8c9e736f6039e67370 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:49.315827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.316307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.316634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.361781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.362792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.362792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.363002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.363594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.365788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.402374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:49.403958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.418615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 866/1729] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:49.418615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.422445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.425877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 864/1730] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:49.426745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.427975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.459952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6147-d2c2-47f2-a9d1-bb6591048ccb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.590050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.590971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.591840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.591840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.592509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.594745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1b7bb-bc30-41be-b79f-b6848e59a367 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.605699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336b960-eabf-46dc-b00a-770f61adca54 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.621694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.622665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.623229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.624640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.627024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.632381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 865/1731] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:49.635972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.636519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.638276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.648208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.651625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.667419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 867/1732] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:49 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:49.669085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.684051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc528d9c-9a41-48c4-8197-cf9e67cd2205 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.693221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.693813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.694170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.694573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.695703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.697838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.714528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:49 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:49.715849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.746565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:49.747369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:49.749964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ab64-76bd-49d0-a487-4b1d79d40834 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.765780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.767000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.767551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.768134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.778997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.780490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.780675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 866/1734] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:49.781591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.818184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 869/1735] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:49 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:49.819180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.837897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393f79-1dc0-4756-b9df-b9fd09d09f85 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.847859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b0a8-f514-438d-9527-bf6dc8347f6d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:49.864418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.865067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.865353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.865634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.866337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:49.866633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.867163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:49.868126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:49.868537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.868634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:49.868988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] PATH_INFO: `/v3/projects/70c633df5e274e7a9dadd542602e9d7e/users/bd40ad40017d48608a718a8575532d7d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:49.917320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c633df5e274e7a9dadd542602e9d7e, user_id=bd40ad40017d48608a718a8575532d7d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:49.918364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 867/1736] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 12:59:49.920141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967c52-f1ce-4c0e-9057-61e4d72abfc3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:49.924332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:49.937494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 870/1737] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:49 2021] PUT /identity/v3/projects/70c633df5e274e7a9dadd542602e9d7e/users/bd40ad40017d48608a718a8575532d7d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:49.956732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640aa1-749d-4136-b690-d649ddd5f279 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.001806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.002098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.002382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.080846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] MFA Rules not processed for user `bd40ad40017d48608a718a8575532d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:50.083605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:50.113966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.115444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.115936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.116477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.119053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.123679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.184141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 868/1738] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:49 2021] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:50.188915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.249307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 871/1739] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:50 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:50.278499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.280308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:50.303525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893f6c3-95d7-41e0-8260-88932cb1736a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.309595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.311299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.311653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.312729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.313288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.315355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.343775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 869/1740] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:50 2021] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:50.344929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.355017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d91bc-830e-4e92-8d60-1a75dead52c1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.360326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.360997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.361284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.361561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.362412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.364856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.377445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 870/1741] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:59:50.377786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc52c0e-0a59-4755-a41d-94673c328087 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.381873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.396519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31550744-e6dd-4471-8d4a-425b84018497 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.401370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.401999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.402288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.402574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.403259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.404952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.419886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 871/1742] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:50.421047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.431918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a12b5-e08f-48ff-ab8b-c9eadf865664 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.439354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.440369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.440743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.441159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] PATH_INFO: `/v3/projects/f0df1ea923da46acbc31296efd139822/users/cc191a10fef54ea89102e1e9a8df839a/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.462020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0df1ea923da46acbc31296efd139822, user_id=cc191a10fef54ea89102e1e9a8df839a, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.463286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.464038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.464670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.465104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81692e5-c614-4440-9b43-244e71a2248f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.465213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.480786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 872/1743] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:50 2021] PUT /identity/v3/projects/f0df1ea923da46acbc31296efd139822/users/cc191a10fef54ea89102e1e9a8df839a/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:50.490826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.491116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.491393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.530576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] MFA Rules not processed for user `cc191a10fef54ea89102e1e9a8df839a`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:50.531752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:50.535193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.536815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.553084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 872/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:50 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:50.613779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 873/1745] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:50 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:50.619010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.630345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899af8-06d0-4078-81b0-8250feed0429 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.694476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.695122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.695420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.695689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.696406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.698311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.726225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 873/1746] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:50 2021] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:50.730780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.741621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a383-ccd1-40af-b0e6-a024ed583067 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.811067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.811686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.811968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.812267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.812976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.814945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.838700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 874/1747] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:50 2021] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:50.842611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.854981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e34b4-1fd1-448e-9343-fe002350d10d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.861435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.862487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.863194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.864806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.866241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.868588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.907894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 874/1748] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:50.912689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:50.923712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4d602-a085-421a-863c-eeeb905fc960 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:50.929452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:50.930330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:50.930641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:50.930979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] PATH_INFO: `/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a/users/bc3b9afee2214e9f9539b4318e86c826/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:50.972550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b22c38f1ff042d3a0c8cf37ebb4870a, user_id=bc3b9afee2214e9f9539b4318e86c826, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:50.975839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:50.995448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 875/1749] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:50 2021] PUT /identity/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a/users/bc3b9afee2214e9f9539b4318e86c826/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:50.999366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:51.010157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc8a4e-8ded-4f91-bd9b-0ecbd0759ed4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:51.091600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:51.092494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:51.093041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:51.093516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:51.094571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:51.096654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e5ef-d8c5-4188-a9ae-00690eed5a86 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:51.111941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 875/1750] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:51.113473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:51.124919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95344c-dd3a-4eeb-bc83-0f572ecada10 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:51.130905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:51.131251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:51.131810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:51.132204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] PATH_INFO: `/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a/users/bc3b9afee2214e9f9539b4318e86c826/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:51.134523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b22c38f1ff042d3a0c8cf37ebb4870a, user_id=bc3b9afee2214e9f9539b4318e86c826, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:51.137544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:51.156329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 876/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:51 2021] PUT /identity/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a/users/bc3b9afee2214e9f9539b4318e86c826/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:51.162107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:51.162437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:51.162777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:51.225699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] MFA Rules not processed for user `bc3b9afee2214e9f9539b4318e86c826`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:51.226952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:51.341962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 876/1752] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:51 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:51.357211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:51.361759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:51.465149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d246af-90a3-420b-acfd-a201ede5d7b8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:51.470417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:51.471267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:51.471703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:51.472124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:51.484770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:51.486669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:51.499148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 877/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:51 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:51.564442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:51.565803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:51.578684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc605-0624-4ccf-916d-f2a69c90a33a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:51.583753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:51.584555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:51.584669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:51.584886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:51.668821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:51.670450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5124f-7063-4430-95bd-ba76b5137a5a service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:51.688761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 877/1754] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:51 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:55.168869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:55.278751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6a1a-57a0-4312-bc47-731ea082aec8 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:55.283388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:55.284373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:55.284611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:55.284883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] PATH_INFO: `/v3/users/bd40ad40017d48608a718a8575532d7d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:55.286171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd40ad40017d48608a718a8575532d7d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:55.288517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:55.349163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd40ad40017d48608a718a8575532d7d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:55.360715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd40ad40017d48608a718a8575532d7d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:55.376034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd40ad40017d48608a718a8575532d7d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:55.377304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd40ad40017d48608a718a8575532d7d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:55.378056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd40ad40017d48608a718a8575532d7d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:55.400949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 878/1755] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:55 2021] DELETE /identity/v3/users/bd40ad40017d48608a718a8575532d7d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:55.405631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:55.406577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:55.407021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:55.441124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:55.443160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:55.529813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 878/1756] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:55.562478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:55.564294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:55.638446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139204a-b054-4aa1-873e-9a3142274dc0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:55.642704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:55.642704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:55.643130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:55.643469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:55.653769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:55.655856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3536ba-878f-4892-aa17-db9e1b0d3a71 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:55.666153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 879/1757] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 12:59:56.609548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:56.610924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:56.622640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451f02-80e9-4a35-971f-e72f8f8aa2c0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:56.627502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:56.628339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:56.628776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:56.629198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] PATH_INFO: `/v3/users/cc191a10fef54ea89102e1e9a8df839a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:56.631142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc191a10fef54ea89102e1e9a8df839a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:56.633491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:56.688509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc191a10fef54ea89102e1e9a8df839a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:56.698633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc191a10fef54ea89102e1e9a8df839a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:56.711770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc191a10fef54ea89102e1e9a8df839a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:56.712873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc191a10fef54ea89102e1e9a8df839a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:56.713604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc191a10fef54ea89102e1e9a8df839a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:56.727921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 879/1758] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:56 2021] DELETE /identity/v3/users/cc191a10fef54ea89102e1e9a8df839a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:56.733053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:56.733556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:56.733986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:56.759994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:56.761679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:56.934935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 880/1759] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:56.948104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:56.950062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:57.051515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1edab-9400-4132-ae62-dd774eebf360 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.056333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.057350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.057745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.058089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.070869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.073756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592356d8-567b-4086-9d2a-8141185fbced service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.085410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 880/1760] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:57.196046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.197908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:57.215844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8fc0f-2c8b-4a10-8914-725cee7c7163 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.228364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.229698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.229888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.230181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] PATH_INFO: `/v3/projects/70c633df5e274e7a9dadd542602e9d7e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.233580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c633df5e274e7a9dadd542602e9d7e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.235548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.339812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c633df5e274e7a9dadd542602e9d7e', 'request_id': 'req-9fbf15ff-bb38-4db5-a7a5-4974a629b594'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:57.355067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c633df5e274e7a9dadd542602e9d7e', 'request_id': 'req-9fbf15ff-bb38-4db5-a7a5-4974a629b594'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:57.378526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c633df5e274e7a9dadd542602e9d7e', 'request_id': 'req-9fbf15ff-bb38-4db5-a7a5-4974a629b594'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:57.394136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] The token cache is being invalidate because project 70c633df5e274e7a9dadd542602e9d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:57.394725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:57.395716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9fbf15ff-bb38-4db5-a7a5-4974a629b594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:57.398018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 881/1761] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:57 2021] DELETE /identity/v3/projects/70c633df5e274e7a9dadd542602e9d7e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:57.404678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.405400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.405928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.433418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:57.435261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:57.539337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 881/1762] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:57.548420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.552505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.553235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.606311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:57.609134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:57.620443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 882/1763] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:57.625089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.638804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464a39-11be-4031-b955-78bd4cb6631a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.667170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.668200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.668745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.669188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.670163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 12:59:57.670748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.672546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.690202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 882/1764] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 12:59:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 12:59:57.694396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.705093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0076b4-0a81-4476-abf1-5527a3988b2a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.711155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.712321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.712679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.713027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.713750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.715885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.753382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 883/1765] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:57 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 12:59:57.756023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.766965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27b58-5bf2-4d50-ab2d-52cdc11cc6fa admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.879098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.880452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.880914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.881350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.882154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.884730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.910874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 883/1766] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:57 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:57.915322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.929876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dc43-feff-41bc-a464-9e73c1524260 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.938749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.940174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.940509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.940790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.941561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.943217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:57.973011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 884/1767] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:57.977284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:57.988057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7875fb-7e7d-46b9-ac72-9e45e8117d72 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:57.994453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:57.994736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:57.994942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:57.995227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:57.995934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:57.997534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3283-d550-4890-ba19-341cac393734 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.019422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 884/1768] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 12:59:58.022250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.036761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd549c-585a-4394-a454-c7af623c6a72 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.051925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.052803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.053089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.053370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] PATH_INFO: `/v3/projects/40e5293044154375899f560190f7d6ee/users/9f7f58b6faa14eb3badbbdb5c9a14804/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.090333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e5293044154375899f560190f7d6ee, user_id=9f7f58b6faa14eb3badbbdb5c9a14804, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.093488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.120572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 885/1769] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:58 2021] PUT /identity/v3/projects/40e5293044154375899f560190f7d6ee/users/9f7f58b6faa14eb3badbbdb5c9a14804/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:58.124488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.124876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.125246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.171152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] MFA Rules not processed for user `9f7f58b6faa14eb3badbbdb5c9a14804`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:58.172462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:58.267342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 885/1770] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:58 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:58.271712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.352635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.354250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:58.436827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2d701-980f-4be0-9d06-a0825fedae19 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.451989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.452646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.452936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.453218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.453892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.457204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.517012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 886/1771] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 12:59:58 2021] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 12:59:58.520428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.522129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0488-0f4d-48de-8c30-3421d772f01c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.656226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc37d-3a82-4cb7-8959-2d47e4808c08 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.661810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.662797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.663228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.663652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.665066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.667519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.675634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.676913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.677295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.677673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] PATH_INFO: `/v3/projects/f0df1ea923da46acbc31296efd139822` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.686591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0df1ea923da46acbc31296efd139822)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.688936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.707018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 887/1772] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 12:59:58 2021] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 12:59:58.711529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.724694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68377-0bab-40b5-ab59-a52d6aba323e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.730757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.731554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.731985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.732500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.733372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.735790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.750640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 888/1773] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:58 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:58.755794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.778249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5909-76aa-406f-ac54-0b9a3ea1e75b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:58.809814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0df1ea923da46acbc31296efd139822', 'request_id': 'req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:58.821282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0df1ea923da46acbc31296efd139822', 'request_id': 'req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:58.847901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0df1ea923da46acbc31296efd139822', 'request_id': 'req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:58.868248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] The token cache is being invalidate because project f0df1ea923da46acbc31296efd139822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:58.868692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:58.869635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:58.874442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 886/1774] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:58 2021] DELETE /identity/v3/projects/f0df1ea923da46acbc31296efd139822 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:58.875680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.876835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:58.891904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:58.893284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:58.893809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:58.895054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] PATH_INFO: `/v3/projects/fb0beb85056942319281be376badc98b/users/edb5e327ded049f1a44a6afc3bce9aac/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:58.920355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0beb85056942319281be376badc98b, user_id=edb5e327ded049f1a44a6afc3bce9aac, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:58.923361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:58.951145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 889/1775] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:58 2021] PUT /identity/v3/projects/fb0beb85056942319281be376badc98b/users/edb5e327ded049f1a44a6afc3bce9aac/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:58.952510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:58.957912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:58.990317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7cd0e-df9a-4792-98fb-b766bd4b7af6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.057345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50f24-6942-44af-a911-0403e9944c8e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.062994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.065014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.065707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.066250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.067175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.069580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.086511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 890/1776] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 12:59:58 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 12:59:59.091440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:59.103219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a807f-5310-4e6b-89d1-8784b67166d0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.107779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.109268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.109661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.110072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] PATH_INFO: `/v3/users/bc3b9afee2214e9f9539b4318e86c826` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.110785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.111694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.111874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3b9afee2214e9f9539b4318e86c826)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.112019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.112328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] PATH_INFO: `/v3/projects/fb0beb85056942319281be376badc98b/users/edb5e327ded049f1a44a6afc3bce9aac/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.114322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.114447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0beb85056942319281be376badc98b, user_id=edb5e327ded049f1a44a6afc3bce9aac, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.118039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501601a-567c-4c87-a25d-256d2b4d76e3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.130849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 891/1777] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 12:59:59 2021] PUT /identity/v3/projects/fb0beb85056942319281be376badc98b/users/edb5e327ded049f1a44a6afc3bce9aac/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 12:59:59.142849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.143145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.143473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.173781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3b9afee2214e9f9539b4318e86c826'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.184285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3b9afee2214e9f9539b4318e86c826'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.186684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] MFA Rules not processed for user `edb5e327ded049f1a44a6afc3bce9aac`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:59.187993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.198146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3b9afee2214e9f9539b4318e86c826'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.199185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3b9afee2214e9f9539b4318e86c826'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.199793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3b9afee2214e9f9539b4318e86c826'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.213735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 887/1778] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:58 2021] DELETE /identity/v3/users/bc3b9afee2214e9f9539b4318e86c826 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:59.277142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 892/1779] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:59 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 12:59:59.288424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:59.290548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.371182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf020-7667-4ff0-a43b-a30355f5629b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.375348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.375936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.376223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.376533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.459464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.461342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.484113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 888/1780] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:59 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 12:59:59.503490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:59.505290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.597969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1640ac2-f2a2-4767-9526-5762087a617b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.673742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.674565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.674847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.675123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] PATH_INFO: `/v3/users/9f7f58b6faa14eb3badbbdb5c9a14804` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.676569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7f58b6faa14eb3badbbdb5c9a14804)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.678523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.731017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:59.733083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.757427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713580a-009f-4f5c-a8cb-5b71208674af service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 12:59:59.766151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7f58b6faa14eb3badbbdb5c9a14804'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.769166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 12:59:59.770153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.770487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.770807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] PATH_INFO: `/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.773313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b22c38f1ff042d3a0c8cf37ebb4870a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 12:59:59.776166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 12:59:59.780597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7f58b6faa14eb3badbbdb5c9a14804'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.794865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7f58b6faa14eb3badbbdb5c9a14804'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.795651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7f58b6faa14eb3badbbdb5c9a14804'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.796375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-77a2f308-cd8b-4145-a068-0d1ef723d30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7f58b6faa14eb3badbbdb5c9a14804'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.815072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 893/1781] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 12:59:59 2021] DELETE /identity/v3/users/9f7f58b6faa14eb3badbbdb5c9a14804 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:59.817072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.817436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.817725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.843358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:59.844808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.885722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b22c38f1ff042d3a0c8cf37ebb4870a', 'request_id': 'req-22a7d42c-1648-43b7-be56-593376644597'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.901238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b22c38f1ff042d3a0c8cf37ebb4870a', 'request_id': 'req-22a7d42c-1648-43b7-be56-593376644597'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.917110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 894/1782] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 12:59:59.918243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b22c38f1ff042d3a0c8cf37ebb4870a', 'request_id': 'req-22a7d42c-1648-43b7-be56-593376644597'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.928197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 12:59:59.930656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 12:59:59.931860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] The token cache is being invalidate because project 3b22c38f1ff042d3a0c8cf37ebb4870a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 12:59:59.932344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.933290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22a7d42c-1648-43b7-be56-593376644597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 12:59:59.935922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 889/1783] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 12:59:59 2021] DELETE /identity/v3/projects/3b22c38f1ff042d3a0c8cf37ebb4870a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 12:59:59.941920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0931-49e1-49a1-8a7a-01f509f70999 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 12:59:59.942370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0931-49e1-49a1-8a7a-01f509f70999 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 12:59:59.942809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0931-49e1-49a1-8a7a-01f509f70999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 12:59:59.985295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-784b0931-49e1-49a1-8a7a-01f509f70999 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 12:59:59.986629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-784b0931-49e1-49a1-8a7a-01f509f70999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.023332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5e538-ed80-49b3-a1e9-3331d2728d2e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.122108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.123153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.123459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.123742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.129015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.143602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 890/1784] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 12:59:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:00.145728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.145728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.145728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.157329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.158982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.186264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 895/1785] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 12:59:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:00:00.194608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:00.196174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.206761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 891/1786] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:00.211570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.221572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a01d-0a25-4e92-8941-032e5c698e8e service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.227926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.228342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.228643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.229342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.230310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:00.231097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.233004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.250559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 896/1787] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:00.256547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.267633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314c22-e5d3-4df5-b95d-bca483bf19c7 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.273003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.273846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.274307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.274728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.275901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.278065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.327274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 892/1788] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:00.332549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.335097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.346084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.346330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f45f1f-777c-43bc-a009-752c16c6ee5f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.471744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f4533-69ba-46b0-b629-b388df5237fa admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.477657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.478541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.478832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.479157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] PATH_INFO: `/v3/users/46cfb2b0e80642a7b6476c758a8e604f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.480458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.480702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cfb2b0e80642a7b6476c758a8e604f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.481268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.481644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.482014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.482777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.483385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.485032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.511252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 897/1789] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:00.516266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.530458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46e94-99a4-4ab0-b595-af36803aaddc admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.536031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.536741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.537196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.537566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.538376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.540793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.552448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 898/1790] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:00.554627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cfb2b0e80642a7b6476c758a8e604f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:00.559628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.567171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cfb2b0e80642a7b6476c758a8e604f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:00.572455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a253-0d08-421d-82ce-e959a217c726 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.577940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.578543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.578832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.579112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.580155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.581659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.582514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cfb2b0e80642a7b6476c758a8e604f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:00.583308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cfb2b0e80642a7b6476c758a8e604f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:00.584019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6844284b-79dd-4442-8f57-c28dc6d1387d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cfb2b0e80642a7b6476c758a8e604f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:00.600358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 899/1791] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:00.600358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.603766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.608176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 893/1792] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:00 2021] DELETE /identity/v3/users/46cfb2b0e80642a7b6476c758a8e604f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:00.612713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.613092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.613455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.617108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd866e6-2bab-4246-b5f1-16f159cf4731 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.640751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:00.642453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.723195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.723955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 894/1793] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:00.734751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.735076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.735597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:00.736038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] PATH_INFO: `/v3/projects/b92a09c63768436ebcf8b908e50e882f/users/71398ff715824650afa4d0887e3d6e97/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.737125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.764937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92a09c63768436ebcf8b908e50e882f, user_id=71398ff715824650afa4d0887e3d6e97, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:00.768170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde599-98c9-4106-95ff-7d0fabe17766 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:00.784777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 900/1794] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:00 2021] PUT /identity/v3/projects/b92a09c63768436ebcf8b908e50e882f/users/71398ff715824650afa4d0887e3d6e97/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:00.795062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.795383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.795624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.825064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f187728-47c7-4a97-8246-bac8a5fbbebf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:00.837070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] MFA Rules not processed for user `71398ff715824650afa4d0887e3d6e97`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:00.838514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:00.919711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:00.920145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:00.920491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:00.920760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:00.994758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 901/1795] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:00.999645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.015221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efe00-db5a-4e6f-bbd3-8ff0e8f2636d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.016829 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.018800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.028398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.029420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.029977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.030126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.030852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.033933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.055535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 895/1796] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:00:01.055535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.057608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.073410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3b47-0c32-4162-9ac4-e7b0b81f65a1 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.079642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.080186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.081037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.081322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] PATH_INFO: `/v3/projects/40e5293044154375899f560190f7d6ee` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.082512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e5293044154375899f560190f7d6ee)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.084474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.088157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 902/1797] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:00 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:01.092154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.180532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e5293044154375899f560190f7d6ee', 'request_id': 'req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.201774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef56b-fd9f-4d09-8c14-41298031c73b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.207272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e5293044154375899f560190f7d6ee', 'request_id': 'req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.223660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e5293044154375899f560190f7d6ee', 'request_id': 'req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.237092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] The token cache is being invalidate because project 40e5293044154375899f560190f7d6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:01.237432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.238784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.241379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 896/1798] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:01 2021] DELETE /identity/v3/projects/40e5293044154375899f560190f7d6ee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:01.246181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.248740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.298818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.299449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.299736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.300013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.301107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.303838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.330792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bb7ef-4f0b-468d-8f16-7fc0682c1cfb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.336928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 903/1799] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:01 2021] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:01.337114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.337114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.337317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.337928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] PATH_INFO: `/v3/users/edb5e327ded049f1a44a6afc3bce9aac` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.338931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.339338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb5e327ded049f1a44a6afc3bce9aac)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.340994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.342659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.355575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005695f-2d24-4e2c-b0a9-f078e42fa3e8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.362752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.363014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.363307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.363583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.364628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.367665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.384230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 904/1800] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:01 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:01.385370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.396045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57760b-eaa7-49c5-973e-f06e62144f9b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.401491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.402482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.402779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.403059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] PATH_INFO: `/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0/users/d35f922c0184446bb157105a503ffa9a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.409176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb5e327ded049f1a44a6afc3bce9aac'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.422127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb5e327ded049f1a44a6afc3bce9aac'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.437657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c2d7534b7549ca80dcd912b75e69a0, user_id=d35f922c0184446bb157105a503ffa9a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.441885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd5a57-1f06-4029-857a-5ceb8c1970d3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.442896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb5e327ded049f1a44a6afc3bce9aac'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.444062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb5e327ded049f1a44a6afc3bce9aac'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.444949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb5e327ded049f1a44a6afc3bce9aac'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.463157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 897/1801] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:01 2021] DELETE /identity/v3/users/edb5e327ded049f1a44a6afc3bce9aac => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:01.466886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 905/1802] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:01 2021] PUT /identity/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0/users/d35f922c0184446bb157105a503ffa9a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:01.470858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.472439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.544271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb178-6026-47da-8772-069a097d7465 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.544586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb178-6026-47da-8772-069a097d7465 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.544914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb178-6026-47da-8772-069a097d7465 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.546783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 906/1803] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 13:00:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 13:00:01.568824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b8c3-1844-44e9-a606-93d0847c030d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.575043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.575735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.576069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.576557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.577310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.579416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.589421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d3c2-00ce-48a2-a510-1e937c5d8da6 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.589708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d3c2-00ce-48a2-a510-1e937c5d8da6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.589988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d3c2-00ce-48a2-a510-1e937c5d8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.600999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 898/1804] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:01 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:01.605492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.625130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fcad0-a175-4d64-a6b5-e57daa84230d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.638914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.640112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.640427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.640699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] PATH_INFO: `/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0/users/d35f922c0184446bb157105a503ffa9a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.643356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c2d7534b7549ca80dcd912b75e69a0, user_id=d35f922c0184446bb157105a503ffa9a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.646235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.657556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4e19d3c2-00ce-48a2-a510-1e937c5d8da6 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:01.665242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4e19d3c2-00ce-48a2-a510-1e937c5d8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.668883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 899/1805] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:01 2021] PUT /identity/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0/users/d35f922c0184446bb157105a503ffa9a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:01.670253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.672632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.807086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63236-61e0-4cec-9f49-4d07cb4f9690 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:01.811702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:01.812572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.812861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.813429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] PATH_INFO: `/v3/projects/8b41e4a65cbd402490258f2ee42f0eb4` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.815078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b41e4a65cbd402490258f2ee42f0eb4)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:01.817364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:01.909248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 907/1806] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 13:00:01 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:01.911203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:01.911490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:01.911767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:01.913394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b41e4a65cbd402490258f2ee42f0eb4', 'request_id': 'req-8a3244d2-5389-4061-ab92-5bf8d023cef4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.933108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b41e4a65cbd402490258f2ee42f0eb4', 'request_id': 'req-8a3244d2-5389-4061-ab92-5bf8d023cef4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.949353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b41e4a65cbd402490258f2ee42f0eb4', 'request_id': 'req-8a3244d2-5389-4061-ab92-5bf8d023cef4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.963383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] The token cache is being invalidate because project 8b41e4a65cbd402490258f2ee42f0eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:01.963664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.964363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:01.968882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 900/1807] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:01 2021] DELETE /identity/v3/projects/8b41e4a65cbd402490258f2ee42f0eb4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:01.970076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:01.971747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:01.988115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] MFA Rules not processed for user `d35f922c0184446bb157105a503ffa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:01.989462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.073916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 908/1808] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:01 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:02.078775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.080411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.094237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3244d2-5389-4061-ab92-5bf8d023cef4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.099614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.100796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.101463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.102881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] PATH_INFO: `/v3/users/2fdc2231aa48497590eda27f380d1030` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.104653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdc2231aa48497590eda27f380d1030)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.107103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.182514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ebbe-5245-410c-b8ce-d06c9977e7b5 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.190169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.190695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.191287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.191397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.193191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdc2231aa48497590eda27f380d1030'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.196770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.207321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdc2231aa48497590eda27f380d1030'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.221202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdc2231aa48497590eda27f380d1030'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.222228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdc2231aa48497590eda27f380d1030'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.222977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdc2231aa48497590eda27f380d1030'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.224946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.237381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.239886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 901/1809] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:01 2021] DELETE /identity/v3/users/2fdc2231aa48497590eda27f380d1030 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:02.241385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.255696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.259500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 909/1810] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:02 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:02.288896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.290905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.306325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172582-2bb1-44cf-af0c-d1385b4b12a6 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.388195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.389242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.389611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.390209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] PATH_INFO: `/v3/projects/fb0beb85056942319281be376badc98b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.391795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0beb85056942319281be376badc98b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.392370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45832-b023-422e-ac9d-5296a1fcb6bb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.393964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.396807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.397504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.397881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.398253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.400633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.502826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0beb85056942319281be376badc98b', 'request_id': 'req-5686f219-caa9-40d5-903a-19fa1bc257ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.505085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.506485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb28fe-0b96-4d08-9b02-ba1a9015cee3 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.516332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0beb85056942319281be376badc98b', 'request_id': 'req-5686f219-caa9-40d5-903a-19fa1bc257ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.530063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 902/1811] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:02 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:02.552347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0beb85056942319281be376badc98b', 'request_id': 'req-5686f219-caa9-40d5-903a-19fa1bc257ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.582875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] The token cache is being invalidate because project fb0beb85056942319281be376badc98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:02.583219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.591787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5686f219-caa9-40d5-903a-19fa1bc257ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:02.599235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 910/1812] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:02 2021] DELETE /identity/v3/projects/fb0beb85056942319281be376badc98b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:02.601676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.602170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.602456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.636700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:02.638654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.729885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 903/1813] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:02.737335 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341006-0115-4097-8193-91997f0e128e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.737626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341006-0115-4097-8193-91997f0e128e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.737903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341006-0115-4097-8193-91997f0e128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.781730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-00341006-0115-4097-8193-91997f0e128e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:02.782897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-00341006-0115-4097-8193-91997f0e128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:02.795724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 911/1814] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:02.800194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.811083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbaa23-8812-4c34-8f38-89ea82d888c3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.816431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.817204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.817495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.817775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.818498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:02.818780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.820526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.836675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 904/1815] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:00:02.841929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00341006-0115-4097-8193-91997f0e128e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.851489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00341006-0115-4097-8193-91997f0e128e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.858168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:02.859625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:02.859964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:02.860511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:02.861333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:02.865042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:02.904475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 912/1816] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:02 2021] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:02.909381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.922128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd701-32e6-45ba-b1c7-86e04e36a6cd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:02.922904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:02.925233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.007932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.008716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.009067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.009415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.009722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a2d1-1a99-4e8c-abd1-fa66ff9f78a5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.010189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.012503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.014414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.015210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.015498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.015782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] PATH_INFO: `/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.021923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2676067f946f4a9e84b4e8e3b397cc5d)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.024999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.040594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 905/1817] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:02 2021] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:03.044440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.059521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488a19e-bd29-448a-a861-62cf47667d05 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.068886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.069482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.069769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.070045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.070995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.072743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.087394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 906/1818] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:03.091056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.103328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c99d-2648-44a5-9205-0e9c058b2724 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.106771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2676067f946f4a9e84b4e8e3b397cc5d', 'request_id': 'req-a789fc13-2d3e-449f-b695-c664b03873bc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:03.115039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2676067f946f4a9e84b4e8e3b397cc5d', 'request_id': 'req-a789fc13-2d3e-449f-b695-c664b03873bc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:03.128088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2676067f946f4a9e84b4e8e3b397cc5d', 'request_id': 'req-a789fc13-2d3e-449f-b695-c664b03873bc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:03.142389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] The token cache is being invalidate because project 2676067f946f4a9e84b4e8e3b397cc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:03.142670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:03.143632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a789fc13-2d3e-449f-b695-c664b03873bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:03.150342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 913/1819] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:02 2021] DELETE /identity/v3/projects/2676067f946f4a9e84b4e8e3b397cc5d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:03.152042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ab8b-22cf-400d-8b7d-3c034f00085c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.152376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ab8b-22cf-400d-8b7d-3c034f00085c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.152742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ab8b-22cf-400d-8b7d-3c034f00085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.176482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b253ab8b-22cf-400d-8b7d-3c034f00085c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:03.177516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.177671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b253ab8b-22cf-400d-8b7d-3c034f00085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.178122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.178432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.178711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.179416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.181188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.188284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 914/1820] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:03.192162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 907/1821] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:03.194586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.195164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.195452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.195948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.197791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.209551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995615d-c661-425b-96d6-4bba2a45a8f7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.214301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.215128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.215418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.215704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] PATH_INFO: `/v3/projects/06e8798c8123480ab308dd298431d030/users/c35cae1650cb413085228c875d520085/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.221576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:03.222840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.232297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 915/1822] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:03.236735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.237963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e8798c8123480ab308dd298431d030, user_id=c35cae1650cb413085228c875d520085, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.246106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd806-fdb3-4060-9501-e52a6287edcc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.249281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae2ba3-eb78-407b-8671-5109266c2d55 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.258285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.258824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.259186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.259559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.260586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:03.261048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.263307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.268138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 908/1823] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:03 2021] PUT /identity/v3/projects/06e8798c8123480ab308dd298431d030/users/c35cae1650cb413085228c875d520085/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:03.273871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.274469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.274943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.287074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 916/1824] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:00:03.288191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.311218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:03.312440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.317577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15be4-87ed-40f1-8f91-fb551a507a2d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.383629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 909/1825] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:03.391737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.392390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.392674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.392945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.393647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.394940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.395744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.396690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.429038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 917/1826] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:03.434283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.475466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1d8b3-eac3-430a-bd90-e02f358b0938 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.511112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927155f-0dfc-4876-a0b6-3af58993d2cd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.517372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.518002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.518295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.518593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.519237 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.521273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.543227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 918/1827] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:03.546481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.547102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.547348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.547472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.547711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.557330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba04ff6-d1bb-49e9-a70f-c67aa0987e33 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.558839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.560719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.562104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.562764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.563054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.563337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.564037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.567741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.573397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 910/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:03.577501 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 919/1829] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:03.581154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.591391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89248643-4a47-4e9a-a5a3-508e35be7ed8 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.597592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.598251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.598537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.598845 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.599576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.601921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0f098-11ad-42eb-ae9c-f36f9b0cd644 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.616744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 911/1830] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:03.618325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.630825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7208-d670-45e1-9aab-8fad736a454c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.636215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.637266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.637556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.637826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] PATH_INFO: `/v3/projects/a4c0e8415b0f4a2281ba704a609a0c38/users/3525cdb2b83342a3ac9853599422ea23/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.678728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c0e8415b0f4a2281ba704a609a0c38, user_id=3525cdb2b83342a3ac9853599422ea23, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.682473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.702054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 920/1831] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:03 2021] PUT /identity/v3/projects/a4c0e8415b0f4a2281ba704a609a0c38/users/3525cdb2b83342a3ac9853599422ea23/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:03.712066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.712654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.712937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.763437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] MFA Rules not processed for user `3525cdb2b83342a3ac9853599422ea23`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:03.764634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:03.860016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:03.866092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 912/1832] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:03.944269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23d5c-db53-4165-8943-9102267a119c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:03.949507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:03.950197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:03.951242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:03.951242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:03.953045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:03.953931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:03.987032 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 921/1833] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:03.989487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.009672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe7dc5-084d-447b-94c8-f02c2f2c5974 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.115036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.116188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.116881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.117368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.118662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.122508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.150335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 913/1834] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:03 2021] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:04.154637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.174346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e4830-1eb9-4f64-baef-f3e46f915d79 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.179520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.180584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.181198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.181650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.182692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.184696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.197215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 922/1835] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:04 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:04.204800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.216432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d5522-0771-477f-8b00-5d1a24e2de7a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.226392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.227291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.227781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.228069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] PATH_INFO: `/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.250754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a409904c7642d5a63a9cda4e6b0e2a, user_id=3bf9e4191d8e4b14b07fcf0dc26f1f0a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.253765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.269878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 914/1836] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:04 2021] PUT /identity/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:04.273873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.284065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de540f-9365-4698-bd51-6e798ae7f052 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.357692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.358313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.358606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.358891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.359595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.361269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256cac6-7cfa-4cb9-8118-efb200f3350d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.374212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 923/1837] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:04 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:04.378139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.392637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642c90-80cf-4674-9e65-d34bc1618a91 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.398707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.399927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.400372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.400657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] PATH_INFO: `/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.402874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a409904c7642d5a63a9cda4e6b0e2a, user_id=3bf9e4191d8e4b14b07fcf0dc26f1f0a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.407819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.424342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 915/1838] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:04 2021] PUT /identity/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:04.431496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bf46-7364-4832-a923-68f7849dd644 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.431930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bf46-7364-4832-a923-68f7849dd644 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.432330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bf46-7364-4832-a923-68f7849dd644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.471738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7cc3bf46-7364-4832-a923-68f7849dd644 None None] MFA Rules not processed for user `3bf9e4191d8e4b14b07fcf0dc26f1f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:04.472755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7cc3bf46-7364-4832-a923-68f7849dd644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:04.597036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 924/1839] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:04 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:04.607891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.609555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:04.684912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.685243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.685493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.771007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bdb3-7fb9-4414-b856-9ab9339e4350 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:04.771816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] MFA Rules not processed for user `c35cae1650cb413085228c875d520085`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:04.773034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:04.778997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:04.779558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:04.779907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:04.781006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:04.836688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:04.838602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:04.876559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 916/1840] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:04 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:04.914529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 925/1841] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:04 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:04.919356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:04.998564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722f8f-42f2-4924-96db-98610605cbc8 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.006731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.007372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.007726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.008007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.008900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.010880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.042930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.058503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4abb46-d3a8-4a11-8597-0a743507dfdd None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.061655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 917/1842] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:04 2021] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:05.066198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.067827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.068573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.069394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.069684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.170945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.172706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.196621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 926/1843] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:05 2021] GET /identity/v3/auth/tokens => generated 3708 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:05.299655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bd1a5-18e7-4ca5-82f3-fd34e88d1d74 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.304197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.304837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.305201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.305546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.306159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.308047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.370235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 918/1844] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:05 2021] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:05.375390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.390175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ec56-43b1-4e97-be61-3beacf6644b5 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.395709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.396680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.397179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.397433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.398349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.400363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.420705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 927/1845] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:05.424819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.439025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf5079-34f8-4cf6-af9c-1d3c2d9bf8fc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.448579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.449430 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.449721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.449997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] PATH_INFO: `/v3/projects/502cf3e5178742479040503a94daa56c/users/a7909bcb60024eb2acb280e7a97c33d4/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.479296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=502cf3e5178742479040503a94daa56c, user_id=a7909bcb60024eb2acb280e7a97c33d4, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.484105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.511070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 919/1846] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:05 2021] PUT /identity/v3/projects/502cf3e5178742479040503a94daa56c/users/a7909bcb60024eb2acb280e7a97c33d4/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:05.516460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.538607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7c6b5-01c2-4e03-b75c-de7604f1f984 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.637265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.638006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.638395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.638903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.639712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.641585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdb8a7-4731-49d3-bcd9-d63101fd677a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.657647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 928/1847] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:05.661427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:05.674982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0fb3e-5a31-4045-be0b-e4d24a1ed5ab admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:05.689711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:05.692039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:05.694114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:05.694114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] PATH_INFO: `/v3/projects/502cf3e5178742479040503a94daa56c/users/a7909bcb60024eb2acb280e7a97c33d4/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:05.698910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] RBAC: Authorizing `identity:create_grant(project_id=502cf3e5178742479040503a94daa56c, user_id=a7909bcb60024eb2acb280e7a97c33d4, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:05.703754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:05.720223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 920/1848] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:05 2021] PUT /identity/v3/projects/502cf3e5178742479040503a94daa56c/users/a7909bcb60024eb2acb280e7a97c33d4/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:06.876091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:06.876091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:06.876091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:06.916309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] MFA Rules not processed for user `a7909bcb60024eb2acb280e7a97c33d4`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:06.921374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:07.015898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 929/1849] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:06 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:07.026812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:07.104197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272277f-2b47-44df-a9af-72c71887debf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:07.109258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:07.110126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:07.110482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:07.110829 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:07.186964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:07.188395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:07.199310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 921/1850] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:07 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:13.232708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:13.247122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:13.249302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:13.260378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3744-f173-45e0-aad5-46b843705053 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:13.270682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:13.271305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:13.271599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:13.271883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:13.295936 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:13.297455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3a960-891c-424c-8815-33240121187b service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:13.318040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 930/1851] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:13 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:13.403340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce264-955b-4e0a-8b78-46e1d33849fb service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:13.411476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:13.413329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:13.413925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:13.414518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] PATH_INFO: `/v3/users/71398ff715824650afa4d0887e3d6e97` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:13.418104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=71398ff715824650afa4d0887e3d6e97)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:13.423597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:13.585744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71398ff715824650afa4d0887e3d6e97'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:13.607869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71398ff715824650afa4d0887e3d6e97'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:13.623448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71398ff715824650afa4d0887e3d6e97'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:13.624648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71398ff715824650afa4d0887e3d6e97'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:13.625541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71398ff715824650afa4d0887e3d6e97'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:13.648541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 922/1852] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:13 2021] DELETE /identity/v3/users/71398ff715824650afa4d0887e3d6e97 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:13.653839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:13.654306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:13.654607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:13.691905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:13.693160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:13.795189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 931/1853] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:13.810613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:13.812444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:13.925801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f920-3632-45be-9cf3-0746373dacbe admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:13.929366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:13.929950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:13.931058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:13.931058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:13.944605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:13.947298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:13.963867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 923/1854] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:14.549266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:14.552830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:14.583538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b361f57-c819-48a7-a5d0-3c67c365e3cd None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:14.591907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:14.593250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:14.594008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:14.595054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] PATH_INFO: `/v3/projects/b92a09c63768436ebcf8b908e50e882f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:14.597758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92a09c63768436ebcf8b908e50e882f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:14.600971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:14.679961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92a09c63768436ebcf8b908e50e882f', 'request_id': 'req-ec7a70ed-f857-416d-80a0-4bdeb945731c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:14.695491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92a09c63768436ebcf8b908e50e882f', 'request_id': 'req-ec7a70ed-f857-416d-80a0-4bdeb945731c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:14.713306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92a09c63768436ebcf8b908e50e882f', 'request_id': 'req-ec7a70ed-f857-416d-80a0-4bdeb945731c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:14.730569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] The token cache is being invalidate because project b92a09c63768436ebcf8b908e50e882f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:14.730911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:14.731589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:14.734232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 932/1855] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:14 2021] DELETE /identity/v3/projects/b92a09c63768436ebcf8b908e50e882f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:14.738053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:14.748016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d42d41-4b06-4db4-bc75-3f6a97a7cfe0 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:14.897242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:14.898741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:14.900792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:14.901096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] PATH_INFO: `/v3/users/d35f922c0184446bb157105a503ffa9a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:14.905069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35f922c0184446bb157105a503ffa9a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:14.908376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:15.047724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35f922c0184446bb157105a503ffa9a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:15.064582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35f922c0184446bb157105a503ffa9a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:15.103572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35f922c0184446bb157105a503ffa9a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:15.104591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35f922c0184446bb157105a503ffa9a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:15.105202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-37e93988-569c-4820-9213-4bf592d9aeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35f922c0184446bb157105a503ffa9a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:15.120530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 924/1856] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:14 2021] DELETE /identity/v3/users/d35f922c0184446bb157105a503ffa9a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:15.713891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:15.715620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:15.735238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a70ed-f857-416d-80a0-4bdeb945731c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:15.864610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:15.866352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:15.867254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:15.868619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] PATH_INFO: `/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:15.871757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c2d7534b7549ca80dcd912b75e69a0)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:15.876941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:15.994955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c2d7534b7549ca80dcd912b75e69a0', 'request_id': 'req-9a03a5d9-baee-49ab-8b4a-df01a18deb31'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.008071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c2d7534b7549ca80dcd912b75e69a0', 'request_id': 'req-9a03a5d9-baee-49ab-8b4a-df01a18deb31'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.038884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c2d7534b7549ca80dcd912b75e69a0', 'request_id': 'req-9a03a5d9-baee-49ab-8b4a-df01a18deb31'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.065216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] The token cache is being invalidate because project e8c2d7534b7549ca80dcd912b75e69a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:16.065510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.066431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9a03a5d9-baee-49ab-8b4a-df01a18deb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.069422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 933/1857] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:15 2021] DELETE /identity/v3/projects/e8c2d7534b7549ca80dcd912b75e69a0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:16.076929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.079684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.080143 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.113482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:16.114868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.222196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 925/1858] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:16.230325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.230638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.230919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.260531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:16.262099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.273266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 934/1859] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:16.277623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.290008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6438e72-2fff-4508-b186-83b00a706070 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.302162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.302791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.303206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.303645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.304393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:16.304695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.306795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.337667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 926/1860] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:16.345069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.361852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142a7f7-d1cb-4e7a-8eb4-43c656adc852 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.368045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.369358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.370468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.370939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.371743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.373976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.393750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.395794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.416844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df8987-5da3-44b3-9aa6-c173d011073b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.422564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 935/1861] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:16.426514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.431830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.435851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.436378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.436808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] PATH_INFO: `/v3/users/3525cdb2b83342a3ac9853599422ea23` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.438087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3525cdb2b83342a3ac9853599422ea23)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.441585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.557894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f38b8-97ac-4b00-92eb-1960b55ca34f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.568114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.569609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.569609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.569743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.570434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.572804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.586887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3525cdb2b83342a3ac9853599422ea23'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.602826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3525cdb2b83342a3ac9853599422ea23'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.609339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 936/1862] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:16.610296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.628495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3525cdb2b83342a3ac9853599422ea23'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.630841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3525cdb2b83342a3ac9853599422ea23'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.632318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-29f5072f-3d63-4b6a-9625-46eb8b8c7af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3525cdb2b83342a3ac9853599422ea23'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:16.634136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0cbd3-8e60-4709-9c76-e6e18fdde62b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.639213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.640283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.640579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.640858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.641558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.643518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.654085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 927/1863] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:16 2021] DELETE /identity/v3/users/3525cdb2b83342a3ac9853599422ea23 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:16.659344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 937/1864] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:16 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:16.661541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.662101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.662579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.665322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.668461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.686133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68083-46c7-4961-bce3-beafcf92cfa6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.688923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:16.690106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.789267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 928/1865] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:16.798916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.799758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.800054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.800810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.801317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.802084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.803062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.803861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.816421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 938/1866] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:16 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:16.820701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:16.837142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912173-6ed3-4d0c-aa12-f8be8aab5b2f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.842567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.845822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.846125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.846418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] PATH_INFO: `/v3/projects/0639503ddae149549126db0341ddd6a9/users/e39cd5263e88451d9b536b36987ca997/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.873725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0639503ddae149549126db0341ddd6a9, user_id=e39cd5263e88451d9b536b36987ca997, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:16.877379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd04e-dc02-449c-932b-71b7c158bd40 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:16.895045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01e4e-6457-4dd8-9e53-5e769ab95355 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:16.904850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 939/1867] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:16 2021] PUT /identity/v3/projects/0639503ddae149549126db0341ddd6a9/users/e39cd5263e88451d9b536b36987ca997/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:16.908227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.908664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.909064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:16.957114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] MFA Rules not processed for user `e39cd5263e88451d9b536b36987ca997`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:16.958374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:16.980030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:16.980694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:16.980980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:16.981259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:17.112840 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:17.114399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:17.133014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 929/1868] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:00:17.164536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 940/1869] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:16 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:17.247565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:17.249153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:17.331674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34019e38-1083-4a4c-8b05-814c3b8b105a service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:17.336032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:17.337045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:17.337435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:17.337791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:17.348212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:17.349819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:17.362431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 930/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:17 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:17.774415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:17.776044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:17.789378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61251fd-3bb1-44d3-b834-02c2984a407f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:17.812002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:17.814711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:17.815236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:17.816102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] PATH_INFO: `/v3/projects/a4c0e8415b0f4a2281ba704a609a0c38` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:17.817955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c0e8415b0f4a2281ba704a609a0c38)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:17.821888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:17.925609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c0e8415b0f4a2281ba704a609a0c38', 'request_id': 'req-3b74c61b-a0d8-4328-9f35-506dcc710c1e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:17.936613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c0e8415b0f4a2281ba704a609a0c38', 'request_id': 'req-3b74c61b-a0d8-4328-9f35-506dcc710c1e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:17.963594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c0e8415b0f4a2281ba704a609a0c38', 'request_id': 'req-3b74c61b-a0d8-4328-9f35-506dcc710c1e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:17.983139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] The token cache is being invalidate because project a4c0e8415b0f4a2281ba704a609a0c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:17.983550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:17.985179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:17.989998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 941/1871] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:17 2021] DELETE /identity/v3/projects/a4c0e8415b0f4a2281ba704a609a0c38 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:17.993987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:18.008217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3696e-61d3-4470-8e12-e11fa75e5de6 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:18.123142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:18.123779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:18.123862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:18.124086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] PATH_INFO: `/v3/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:18.125850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf9e4191d8e4b14b07fcf0dc26f1f0a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:18.127709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:18.223422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf9e4191d8e4b14b07fcf0dc26f1f0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:18.238830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf9e4191d8e4b14b07fcf0dc26f1f0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:18.261519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf9e4191d8e4b14b07fcf0dc26f1f0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:18.262281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf9e4191d8e4b14b07fcf0dc26f1f0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:18.262883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f551bd76-0a41-4329-b6f8-2bb64dd12947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf9e4191d8e4b14b07fcf0dc26f1f0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:18.285072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 931/1872] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:17 2021] DELETE /identity/v3/users/3bf9e4191d8e4b14b07fcf0dc26f1f0a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:19.265385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:19.266786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:19.311054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74c61b-a0d8-4328-9f35-506dcc710c1e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:19.388081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:19.389190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:19.389509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:19.389788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] PATH_INFO: `/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:19.391128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a409904c7642d5a63a9cda4e6b0e2a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:19.393940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:19.456333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a409904c7642d5a63a9cda4e6b0e2a', 'request_id': 'req-1ba55879-80ff-4e28-a240-624b18aaf1b8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:19.467393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a409904c7642d5a63a9cda4e6b0e2a', 'request_id': 'req-1ba55879-80ff-4e28-a240-624b18aaf1b8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:19.483229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a409904c7642d5a63a9cda4e6b0e2a', 'request_id': 'req-1ba55879-80ff-4e28-a240-624b18aaf1b8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:19.498907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] The token cache is being invalidate because project c8a409904c7642d5a63a9cda4e6b0e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:19.499226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:19.499855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ba55879-80ff-4e28-a240-624b18aaf1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:19.507795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 942/1873] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:19 2021] DELETE /identity/v3/projects/c8a409904c7642d5a63a9cda4e6b0e2a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:19.509224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:19.509808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:19.509808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:19.554594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:19.557835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:19.652260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:19.652567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:19.652858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:19.653136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 932/1874] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:19.686745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:19.690646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:19.708153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 943/1875] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:19.712894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:19.727086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc1f5b-5f36-43f2-9a9d-017eb27667e2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:19.733343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:19.733954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:19.734236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:19.734512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:19.735213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:19.735513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:19.737184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:19.778005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:19.787522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 933/1876] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:19.794486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c80e5-b7fd-4037-9dbc-bc54c6be9590 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:19.804200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:19.805249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:19.805598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:19.805933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:19.806854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:19.808868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:19.861911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 944/1877] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:19 2021] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:19.867644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:19.882629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2023d-a445-4005-990f-f165e5388b9d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.059799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.060855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.061384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.061895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.062784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.071503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.113177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.129374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 934/1878] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:19 2021] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:20.133057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422639-7500-457e-b983-e35e689635cd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.140554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.141475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.142809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.143613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.145889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.147906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.173890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.176811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 945/1879] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:20 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:20.191167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50527c-09b4-4243-a3d0-e999f9d73e43 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.197591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.198197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.198479 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.198754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.199484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.203983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3feef-307f-4eed-bc77-f9fb5af2d406 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.221963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 935/1880] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:20.222890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.236928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beda35-1c5b-48a1-82f2-0208e1d3871a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.248294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.250881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.251319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.251761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] PATH_INFO: `/v3/projects/932a5450c7654d13a79985eb06abb125/users/0699dbe78dde44309954ff34de86da24/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.295151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932a5450c7654d13a79985eb06abb125, user_id=0699dbe78dde44309954ff34de86da24, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.298634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.321979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 946/1881] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:20 2021] PUT /identity/v3/projects/932a5450c7654d13a79985eb06abb125/users/0699dbe78dde44309954ff34de86da24/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:20.332275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.333174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.333556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.386410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] MFA Rules not processed for user `0699dbe78dde44309954ff34de86da24`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:20.387878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:20.482126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 936/1882] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:20 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:20.483898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.568781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d302c7-c893-445a-b785-cfd3b4ca78f9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.573490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.574092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.574757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.575247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.575918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.577950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.613065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 947/1883] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:20 2021] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:20.614198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.626044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215a81-ee16-4bfc-bd69-f989f5eb995b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.736838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.737494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.737787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.742263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.743080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.745061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.779153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 937/1884] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:20 2021] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:20.783454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.794879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f567f3c-d9d1-4847-8364-e20f5c7ecbc5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.799879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.800801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.801306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.801962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.802909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.804892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.830697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 948/1885] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:20 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:20.834684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.848085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc35aa-3f7b-42c7-a8ba-1460d53a4603 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.853988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.854947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.855292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.855628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.856630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.859862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5adcc-a32d-495b-a682-394887cafd2f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.876133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 938/1886] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:20.877014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:20.889096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41468-4907-49a3-a86b-86a1d21c35b7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:20.901226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:20.902072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.904662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.904990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] PATH_INFO: `/v3/projects/9dd5634a70734312a3267b11aa8087a4/users/8d123fa07e284bc7aaeea33dce507084/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:20.929483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd5634a70734312a3267b11aa8087a4, user_id=8d123fa07e284bc7aaeea33dce507084, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:20.932396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:20.951388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 949/1887] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:20 2021] PUT /identity/v3/projects/9dd5634a70734312a3267b11aa8087a4/users/8d123fa07e284bc7aaeea33dce507084/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:20.963512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:20.963800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:20.964094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.007695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] MFA Rules not processed for user `8d123fa07e284bc7aaeea33dce507084`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:21.009039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:21.100636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 939/1888] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:20 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:21.104347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.201951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89407da-61cc-4f66-bc6a-8582297df2d2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.210543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.213172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.213755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.214594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.215596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.218655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.257050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 950/1889] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:21 2021] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:21.261075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.273499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24390dbd-c3e7-4f23-bb46-4e1e4d3323ac None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.377658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.378469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.379566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.379913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.380771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.393885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.430380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 940/1890] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:21 2021] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:21.435892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.454907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f082f1d-75be-4a8e-a4f4-059725f04366 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.465219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.466262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.466773 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.467949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.469087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.471509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.490396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 951/1891] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:21.495420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.505953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84702cb4-e6bb-4e3c-8182-486c5b1acb7c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.511243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.512580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.512867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.513150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] PATH_INFO: `/v3/projects/f4581181dc614e79b03ede592d6aa62e/users/2f49e8c67a3c4fbaa9d8093f742311f5/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.545721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4581181dc614e79b03ede592d6aa62e, user_id=2f49e8c67a3c4fbaa9d8093f742311f5, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.548856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.563610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 941/1892] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:21 2021] PUT /identity/v3/projects/f4581181dc614e79b03ede592d6aa62e/users/2f49e8c67a3c4fbaa9d8093f742311f5/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:21.567958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.578667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a8682-58f2-4f6f-80c0-6b1474979245 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.643897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.644584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.644902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.645160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.645856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.647491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ceca-9617-40c8-bc4f-8459eb7c04d4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.658372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 952/1893] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:21.662730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.673319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d188-874e-419e-b977-676867ca6629 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.678393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.679216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.679501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.679779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] PATH_INFO: `/v3/projects/f4581181dc614e79b03ede592d6aa62e/users/2f49e8c67a3c4fbaa9d8093f742311f5/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.681821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4581181dc614e79b03ede592d6aa62e, user_id=2f49e8c67a3c4fbaa9d8093f742311f5, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.685083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.696995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 942/1894] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:21 2021] PUT /identity/v3/projects/f4581181dc614e79b03ede592d6aa62e/users/2f49e8c67a3c4fbaa9d8093f742311f5/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:21.708488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.708915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.709406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.760345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] MFA Rules not processed for user `2f49e8c67a3c4fbaa9d8093f742311f5`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:21.761542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:21.852516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 953/1895] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:21 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:21.864156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:21.866238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:21.947145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb146-8ea8-4f04-adb8-3e35b976ab47 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:21.951181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:21.951843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:21.952195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:21.952575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:21.962765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:21.965641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:21.976846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 943/1896] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:21 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:22.039719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:22.041319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:22.053406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d951-c4db-4340-8bd3-e8bb1cc04c48 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:22.057773 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:22.058373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:22.058654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:22.058950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:22.133166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:22.134608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6845a-c6e3-44e6-9fd1-b23f01b138ca service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:22.144277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 954/1897] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:22 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:22.366690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:22.369219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:22.457743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1cae4-07d6-429f-8da8-d1466a9a1946 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:22.462648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:22.463568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:22.463944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:22.464410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] PATH_INFO: `/v3/users/e39cd5263e88451d9b536b36987ca997` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:22.465709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39cd5263e88451d9b536b36987ca997)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:22.467772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:22.518937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39cd5263e88451d9b536b36987ca997'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:22.526657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39cd5263e88451d9b536b36987ca997'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:22.542417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39cd5263e88451d9b536b36987ca997'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:22.543257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39cd5263e88451d9b536b36987ca997'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:22.543841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39cd5263e88451d9b536b36987ca997'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:22.557890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 944/1898] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:22 2021] DELETE /identity/v3/users/e39cd5263e88451d9b536b36987ca997 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:22.562326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:22.563243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:22.563722 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:22.600651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:22.602569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:22.691042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 955/1899] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:22.704165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:22.705609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:22.776583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b009b5-ed95-4d5d-8ae6-aef9a8959a8f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:22.780227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:22.780832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:22.781122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:22.781394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:22.791014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:22.792664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778938a-4559-4aa7-8379-ba13631c1dac service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:22.802529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 945/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:23.319801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.321796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:23.334712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883db5-c5d1-4415-be7d-3482d0eb7c44 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.340535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.341354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.341641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.341923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] PATH_INFO: `/v3/projects/0639503ddae149549126db0341ddd6a9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.343208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0639503ddae149549126db0341ddd6a9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.345314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.404334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0639503ddae149549126db0341ddd6a9', 'request_id': 'req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:23.415934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0639503ddae149549126db0341ddd6a9', 'request_id': 'req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:23.433513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0639503ddae149549126db0341ddd6a9', 'request_id': 'req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:23.446847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] The token cache is being invalidate because project 0639503ddae149549126db0341ddd6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:23.447138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:23.448110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d268d058-86dc-4a78-9fe3-2cb00b12f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:23.450263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 956/1901] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:23 2021] DELETE /identity/v3/projects/0639503ddae149549126db0341ddd6a9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:23.457856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.458146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.458426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.482534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:23.483713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:23.559127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 946/1902] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:23.567178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.567685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.567769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.591342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:23.592639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:23.600963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 957/1903] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:23.605811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.615272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f5a57-2a26-4bd3-b8ff-08a094cf41dd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.621073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.621664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.621945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.622224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.622936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:23.623232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.624855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.639510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 947/1904] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:23.644055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.654492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37da08-f7c6-4119-8e5b-1a5f198683af None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.659373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.660107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.660509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.660977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.661707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.663713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.692507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 958/1905] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:23 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:23.696822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.709251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6845-687e-401c-9f69-ff4e0e5e1bab admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.778809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.779422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.779705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.779991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.780724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.782735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.806219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 948/1906] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:23 2021] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:23.811320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.828596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e1eab-d17a-4c43-b560-70428263b88e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.834100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.834780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.835070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.835391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.836142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.837867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.852798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 959/1907] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:23.855265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.866128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18edf3-922c-4363-94c2-0a7de9e17d85 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.871151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.872657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.872985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.873258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.873983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.875562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c057eb-cdad-40ff-a8d1-aecf32ebfe8e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.887460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 949/1908] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:23.892108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:23.904228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704993dc-6039-4cbe-bb15-cc2471372672 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:23.909279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:23.910173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.910450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.910724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] PATH_INFO: `/v3/projects/3fd1f23edef0427cb7d63113471a56be/users/94666fce47d649a8aa99335ed479ec13/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:23.934657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd1f23edef0427cb7d63113471a56be, user_id=94666fce47d649a8aa99335ed479ec13, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:23.939670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:23.961470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 960/1909] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:23 2021] PUT /identity/v3/projects/3fd1f23edef0427cb7d63113471a56be/users/94666fce47d649a8aa99335ed479ec13/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:23.972594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:23.972953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:23.973237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:24.015310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] MFA Rules not processed for user `94666fce47d649a8aa99335ed479ec13`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:24.016507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:24.103311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 950/1910] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:23 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:24.112336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:24.114230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:24.181576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6d85-1fa8-4b79-8649-373148ea7cac admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:24.185461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:24.186069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:24.186350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:24.186624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:24.195502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:24.197249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250a543-f29d-4174-95d4-d808772267ef service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:24.207234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 961/1911] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:24 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:24.231989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:24.311149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99346ef-15d3-4fc4-8db3-890b8c25c107 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:24.315872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:24.316777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:24.317071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:24.317357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] PATH_INFO: `/v3/users/94666fce47d649a8aa99335ed479ec13` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:24.318543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94666fce47d649a8aa99335ed479ec13)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:24.320804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:24.393505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94666fce47d649a8aa99335ed479ec13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:24.405477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94666fce47d649a8aa99335ed479ec13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:24.423116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94666fce47d649a8aa99335ed479ec13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:24.423946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94666fce47d649a8aa99335ed479ec13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:24.424684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94666fce47d649a8aa99335ed479ec13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:24.446640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 951/1912] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:24 2021] DELETE /identity/v3/users/94666fce47d649a8aa99335ed479ec13 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:24.451545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:24.451834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:24.452123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:24.475996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:24.477428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:24.573565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 962/1913] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:24.583911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:24.585962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:24.675766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9618-ace2-4ab8-ba62-e78b3f8cda46 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:24.679413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:24.680016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:24.680337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:24.680620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:24.690197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:24.691621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cbeb3-f478-4eba-bb09-48e048cac422 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:24.701495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 952/1914] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:25.107411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.108901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:25.121961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ff08-fd36-40b3-b65c-d92802d66626 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.127394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.128272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.128564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.129195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] PATH_INFO: `/v3/projects/3fd1f23edef0427cb7d63113471a56be` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.130370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd1f23edef0427cb7d63113471a56be)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.132323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.190123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd1f23edef0427cb7d63113471a56be', 'request_id': 'req-7075d772-d895-4200-bb73-259b760a1d34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:25.199615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd1f23edef0427cb7d63113471a56be', 'request_id': 'req-7075d772-d895-4200-bb73-259b760a1d34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:25.211747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd1f23edef0427cb7d63113471a56be', 'request_id': 'req-7075d772-d895-4200-bb73-259b760a1d34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:25.222681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] The token cache is being invalidate because project 3fd1f23edef0427cb7d63113471a56be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:25.222869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:25.223565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7075d772-d895-4200-bb73-259b760a1d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:25.225125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 963/1915] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:25 2021] DELETE /identity/v3/projects/3fd1f23edef0427cb7d63113471a56be => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:25.230993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.231865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.232155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.256596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:25.257772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:25.329376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 953/1916] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:25.338912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.339217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.339490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.378077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:25.379736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:25.389506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 964/1917] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:25.394841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.405167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a589306-53db-46cd-b837-b42c5306e3d8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.410126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.410713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.410993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.411387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.412089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:25.412432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.414063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.429137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 954/1918] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:25.439415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.443002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c965a3-519f-4627-8d4b-c2376aa73090 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.447821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.448450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.448727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.449002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.449648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.451606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.482330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 965/1919] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:25 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:25.490160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.502049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df42049-43f4-41a9-840e-bf6da174a21d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.576337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.576955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.577243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.577523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.578196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.583560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.604109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 955/1920] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:25 2021] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:25.609188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.621666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af261-ac83-4b61-ba8d-00189ee2d588 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.631209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.632712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.633369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.633849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.635060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.637578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.648942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 966/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:25.653120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.665903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de582e02-60c4-4c9a-8aa2-cfc547ded99b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.675985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.676654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.676930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.677216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.679100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.681620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b058d7-7223-4b2a-ab77-80cda6bce3cf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.699092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 956/1922] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:25 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:25.700460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.715222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd662f7-a596-42c7-94a9-8b65a9fbc784 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:25.721974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:25.723312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.723698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.724069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] PATH_INFO: `/v3/projects/727d331da092466b8d717a7e039a5b7b/users/6bb98e201f2f41b18735465a450909ad/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.751123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727d331da092466b8d717a7e039a5b7b, user_id=6bb98e201f2f41b18735465a450909ad, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:25.755346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:25.771766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 967/1923] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:25 2021] PUT /identity/v3/projects/727d331da092466b8d717a7e039a5b7b/users/6bb98e201f2f41b18735465a450909ad/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:25.786585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:25.786879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:25.787177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:25.831151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] MFA Rules not processed for user `6bb98e201f2f41b18735465a450909ad`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:25.833277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:25.941745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 957/1924] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:25 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:25.982867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:25.984641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:26.066110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7972abc-1dc7-40f4-ad58-a489ac81d0a5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:26.072905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:26.073720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:26.074069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:26.074336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:26.086117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:26.087639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6892-90b7-4620-897f-597ffc6fac7c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:26.101610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 968/1925] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:25 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:31.326220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:31.327609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:31.407067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96cf58-f12a-4dd2-940c-2a2445d52777 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:31.411944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:31.412868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:31.413222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:31.413568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] PATH_INFO: `/v3/users/0699dbe78dde44309954ff34de86da24` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:31.414797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0699dbe78dde44309954ff34de86da24)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:31.417019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:31.474511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0699dbe78dde44309954ff34de86da24'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:31.483388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0699dbe78dde44309954ff34de86da24'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:31.496697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0699dbe78dde44309954ff34de86da24'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:31.497454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0699dbe78dde44309954ff34de86da24'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:31.498056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0699dbe78dde44309954ff34de86da24'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:31.513444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 958/1926] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:31 2021] DELETE /identity/v3/users/0699dbe78dde44309954ff34de86da24 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:31.518315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edf1b2-8b67-4cf8-9a44-786f1c508404 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:31.518875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edf1b2-8b67-4cf8-9a44-786f1c508404 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:31.519281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edf1b2-8b67-4cf8-9a44-786f1c508404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:31.544809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-36edf1b2-8b67-4cf8-9a44-786f1c508404 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:31.545887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-36edf1b2-8b67-4cf8-9a44-786f1c508404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:31.621631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 969/1927] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:31.634939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:31.638145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:31.723622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34cb5-0792-4089-8060-f33574284800 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:31.727865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:31.728809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:31.729162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:31.729503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:31.739172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:31.740719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:31.752368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 959/1928] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:31.917444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80710fd0-d578-4140-8baa-a4b9404dc1ba None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:31.917927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80710fd0-d578-4140-8baa-a4b9404dc1ba None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:31.918380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80710fd0-d578-4140-8baa-a4b9404dc1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:31.940219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-80710fd0-d578-4140-8baa-a4b9404dc1ba None None] MFA Rules not processed for user `c023f89fd3da4bc8b38963bed4e5cc63`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:31.941473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-80710fd0-d578-4140-8baa-a4b9404dc1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:32.010612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 970/1929] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:31 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:32.233430 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:32.235623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:32.251294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8536f-7293-4cbe-81d4-0f29c1fb3628 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:32.262871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8767-de42-4d89-873e-40122cf1244a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:32.263165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8767-de42-4d89-873e-40122cf1244a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:32.263451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8767-de42-4d89-873e-40122cf1244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:32.263907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:32.265475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:32.265945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:32.266312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] PATH_INFO: `/v3/projects/932a5450c7654d13a79985eb06abb125` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:32.267553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932a5450c7654d13a79985eb06abb125)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:32.270598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:32.305297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-652b8767-de42-4d89-873e-40122cf1244a None None] MFA Rules not processed for user `6bb98e201f2f41b18735465a450909ad`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:32.306665 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-652b8767-de42-4d89-873e-40122cf1244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:32.355349 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932a5450c7654d13a79985eb06abb125', 'request_id': 'req-771929bb-6f9b-4315-9829-a23e1e120e40'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.376957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932a5450c7654d13a79985eb06abb125', 'request_id': 'req-771929bb-6f9b-4315-9829-a23e1e120e40'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.394560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932a5450c7654d13a79985eb06abb125', 'request_id': 'req-771929bb-6f9b-4315-9829-a23e1e120e40'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.411819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 971/1930] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:32 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:32.417211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] The token cache is being invalidate because project 932a5450c7654d13a79985eb06abb125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:32.417651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.418537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.420735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 960/1931] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:32 2021] DELETE /identity/v3/projects/932a5450c7654d13a79985eb06abb125 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:32.424677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8767-de42-4d89-873e-40122cf1244a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:32.436891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8767-de42-4d89-873e-40122cf1244a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:32.520741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:32.522650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:32.523175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:32.523811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] PATH_INFO: `/v3/users/8d123fa07e284bc7aaeea33dce507084` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:32.525375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d123fa07e284bc7aaeea33dce507084)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:32.527641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:32.607564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d123fa07e284bc7aaeea33dce507084'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.619798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d123fa07e284bc7aaeea33dce507084'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.635933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d123fa07e284bc7aaeea33dce507084'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.637170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d123fa07e284bc7aaeea33dce507084'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.638028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d123fa07e284bc7aaeea33dce507084'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:32.655364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 972/1932] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:32 2021] DELETE /identity/v3/users/8d123fa07e284bc7aaeea33dce507084 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:33.351247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:33.353057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:33.366752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771929bb-6f9b-4315-9829-a23e1e120e40 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:33.472489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:33.473473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:33.473846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:33.474194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] PATH_INFO: `/v3/projects/9dd5634a70734312a3267b11aa8087a4` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:33.475791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd5634a70734312a3267b11aa8087a4)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:33.478481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:33.570369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd5634a70734312a3267b11aa8087a4', 'request_id': 'req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.582619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd5634a70734312a3267b11aa8087a4', 'request_id': 'req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.598124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd5634a70734312a3267b11aa8087a4', 'request_id': 'req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.613149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] The token cache is being invalidate because project 9dd5634a70734312a3267b11aa8087a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:33.613627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.615498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.617398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 961/1933] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:33 2021] DELETE /identity/v3/projects/9dd5634a70734312a3267b11aa8087a4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:33.621569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:33.623223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:33.641607 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4347ecd-9fbc-496c-95ee-f771c4772570 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:33.759478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:33.760738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:33.761769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:33.762162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] PATH_INFO: `/v3/users/2f49e8c67a3c4fbaa9d8093f742311f5` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:33.763459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f49e8c67a3c4fbaa9d8093f742311f5)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:33.765438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:33.829459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f49e8c67a3c4fbaa9d8093f742311f5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.839493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f49e8c67a3c4fbaa9d8093f742311f5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.854418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f49e8c67a3c4fbaa9d8093f742311f5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.855150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f49e8c67a3c4fbaa9d8093f742311f5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.855970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-db15cb68-56de-42e3-8863-511f64aecf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f49e8c67a3c4fbaa9d8093f742311f5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:33.883779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 973/1934] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:33 2021] DELETE /identity/v3/users/2f49e8c67a3c4fbaa9d8093f742311f5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:34.457392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:34.458801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:34.474389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1726a-e6d2-4582-80df-3d9d3f6cc622 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:34.557638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:34.558459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.558761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.559045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] PATH_INFO: `/v3/projects/f4581181dc614e79b03ede592d6aa62e` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.560697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4581181dc614e79b03ede592d6aa62e)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:34.562649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:34.617495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4581181dc614e79b03ede592d6aa62e', 'request_id': 'req-968c1af8-c63d-426f-a9f8-6afb81976017'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.626536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4581181dc614e79b03ede592d6aa62e', 'request_id': 'req-968c1af8-c63d-426f-a9f8-6afb81976017'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.640435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4581181dc614e79b03ede592d6aa62e', 'request_id': 'req-968c1af8-c63d-426f-a9f8-6afb81976017'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.651840 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] The token cache is being invalidate because project f4581181dc614e79b03ede592d6aa62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:34.652168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.654586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.656943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 962/1935] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:34 2021] DELETE /identity/v3/projects/f4581181dc614e79b03ede592d6aa62e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:34.663960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb01d-42fc-4aa6-a975-05bde9f21a24 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.664556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb01d-42fc-4aa6-a975-05bde9f21a24 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.664556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb01d-42fc-4aa6-a975-05bde9f21a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.693850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:34.696253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:34.705486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-10cbb01d-42fc-4aa6-a975-05bde9f21a24 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:34.706721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-10cbb01d-42fc-4aa6-a975-05bde9f21a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:34.798970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c1af8-c63d-426f-a9f8-6afb81976017 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:34.804441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:34.805460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.805816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.806112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] PATH_INFO: `/v3/users/499c3ea7403049119285bb3423929f9d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.807929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499c3ea7403049119285bb3423929f9d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:34.809980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:34.821229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 974/1936] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:34.830034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.830333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.830620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.886242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:34.887687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:34.901171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 975/1937] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:34.905702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:34.909603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499c3ea7403049119285bb3423929f9d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.915455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7503a-3a00-49e1-b7a5-f6e358224c9d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:34.920796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:34.921679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.921863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499c3ea7403049119285bb3423929f9d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.922302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.922746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.923655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:34.924086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:34.926074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:34.940757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499c3ea7403049119285bb3423929f9d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.942002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499c3ea7403049119285bb3423929f9d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.942751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b91ca4c9-40fb-4209-9d64-601a1658fbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499c3ea7403049119285bb3423929f9d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:34.952277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 976/1938] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:34.953261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:34.955213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:34.959005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 963/1939] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:34 2021] DELETE /identity/v3/users/499c3ea7403049119285bb3423929f9d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:34.963557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:34.963952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:34.964360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:34.968578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad043-f312-43b6-8ad0-4bc5481716a7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:34.989737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:34.991186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:35.041678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.042147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.042604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.043060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.043860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.047006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.074939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 964/1940] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:00:35.083243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 977/1941] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:34 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:35.087822 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.088004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.089472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:35.173603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd040d-7fdb-4a85-b439-c427ee0f1588 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.176385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046a51-5f31-4a65-8242-9d0d44c825f6 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.178206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.178852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.179134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.179419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.180109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.182416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.210232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 978/1942] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:35 2021] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:00:35.220772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.237353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dbfa7-6bfd-4984-974f-3e842d6afc32 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.242227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.242889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.243174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.243691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.244149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.244626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.245041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.245333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.245619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.246546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.256306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.258010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.259667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 979/1943] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:35 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:35.264787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.271848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 965/1944] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:00:35.278062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461f57a-696f-423a-9492-2e38b5924ebb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.283420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.284067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.284535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.285001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.285745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.287505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e738e5-f691-40ed-93d4-1af3f0b3cde4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.308693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 980/1945] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:35 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:35.308881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.321074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564820-e7ea-4147-b9b6-163a4af960a0 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.337153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.338959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.339350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.340204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] PATH_INFO: `/v3/projects/8549da5be8454b71bdacfd7a2d9b29ac/users/95ad5c90de5d48d4a4105f1947dc9943/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.391716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8549da5be8454b71bdacfd7a2d9b29ac, user_id=95ad5c90de5d48d4a4105f1947dc9943, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.394590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.425030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 966/1946] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:35 2021] PUT /identity/v3/projects/8549da5be8454b71bdacfd7a2d9b29ac/users/95ad5c90de5d48d4a4105f1947dc9943/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:35.447429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.448199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.448516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.545268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] MFA Rules not processed for user `95ad5c90de5d48d4a4105f1947dc9943`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:35.546548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:35.690272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 981/1947] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:35 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:35.692352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.869304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb09b0-88aa-4e0a-abb4-223802df14e8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:35.881135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:35.881877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:35.883093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:35.892737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:35.894673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:35.900472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:35.952290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 967/1948] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:35 2021] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:35.954998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.955169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:35.956930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:35.979844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09391-3c04-4a60-b9d6-90b4c699d780 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.057686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e012-b2a5-4e6a-93e5-e9a3c366845b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.071131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.072144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.072597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.073018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.073899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.077372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.109718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 968/1949] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:35 2021] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:36.115218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:36.125741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.126907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fb6-306d-41ba-b35c-ac30e914e989 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.127159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.128585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.129369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] PATH_INFO: `/v3/projects/8a1db1f28b6949fcaa1c08a2158ab950` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.131148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1db1f28b6949fcaa1c08a2158ab950)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.132887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.133490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.133753 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.133860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.134115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.135071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.136776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.161977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 969/1950] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:36.168533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:36.193940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15534055-a89a-48a0-bcb4-a7a8d6608c85 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.211490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1db1f28b6949fcaa1c08a2158ab950', 'request_id': 'req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.225140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1db1f28b6949fcaa1c08a2158ab950', 'request_id': 'req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.239619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1db1f28b6949fcaa1c08a2158ab950', 'request_id': 'req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.252606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] The token cache is being invalidate because project 8a1db1f28b6949fcaa1c08a2158ab950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:36.253205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.254302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.258686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 982/1951] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:35 2021] DELETE /identity/v3/projects/8a1db1f28b6949fcaa1c08a2158ab950 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:36.260249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:36.262010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:36.354611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.356905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.358642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.359512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] PATH_INFO: `/v3/projects/7194a650fc964078bd302338e4a88432/users/93e92c186ed6405385b4475b20827498/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.362520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b1765-ede0-42ac-8aa3-2dd01ecc1148 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.369886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.371311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.371632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.372629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] PATH_INFO: `/v3/users/7b47bf40c9ee48a2a19b22316be438c3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.374567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b47bf40c9ee48a2a19b22316be438c3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.377334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.418434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7194a650fc964078bd302338e4a88432, user_id=93e92c186ed6405385b4475b20827498, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.421697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.459210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 970/1952] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:36 2021] PUT /identity/v3/projects/7194a650fc964078bd302338e4a88432/users/93e92c186ed6405385b4475b20827498/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:36.463500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:36.466072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:36.466978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b47bf40c9ee48a2a19b22316be438c3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.483661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b47bf40c9ee48a2a19b22316be438c3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.501691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b47bf40c9ee48a2a19b22316be438c3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.503981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b47bf40c9ee48a2a19b22316be438c3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.506266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b47bf40c9ee48a2a19b22316be438c3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:36.523891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 983/1953] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:36 2021] DELETE /identity/v3/users/7b47bf40c9ee48a2a19b22316be438c3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:36.648363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcae3-63f7-42e4-8755-854df9f0e8ba admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.732621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.733285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.733528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.733767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.734739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.736149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf4dc1-096f-4239-8a8e-8cdd0e4be507 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.751201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 971/1954] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:36 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:36.752615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:36.754422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:36.769469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd71bb-eb59-4d04-926f-e55a3178e11c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:36.775263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:36.776707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.777875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.778402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] PATH_INFO: `/v3/projects/7194a650fc964078bd302338e4a88432/users/93e92c186ed6405385b4475b20827498/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.780595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7194a650fc964078bd302338e4a88432, user_id=93e92c186ed6405385b4475b20827498, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:36.784880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:36.797916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 984/1955] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:36 2021] PUT /identity/v3/projects/7194a650fc964078bd302338e4a88432/users/93e92c186ed6405385b4475b20827498/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:36.810807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:36.811134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:36.811377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:36.881677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] MFA Rules not processed for user `93e92c186ed6405385b4475b20827498`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:36.882825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.005096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 972/1956] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:36 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:37.016796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.018489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.125536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f35da-fea6-482d-9039-649bda3b552b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.129734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.130408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.130746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.131042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.132789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.214302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.215602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.288967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.290793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab4a01-1f1e-4fcf-a717-b1f2f74d4c13 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.303012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 985/1957] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:37 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:37.344512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f769f50-6fae-4b3b-8579-c4c896ad548c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.349036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.350053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.350700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.351125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] PATH_INFO: `/v3/projects/836d671d99264c739052666285f99d44` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.352606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=836d671d99264c739052666285f99d44)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.364064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.430134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836d671d99264c739052666285f99d44', 'request_id': 'req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:37.440229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836d671d99264c739052666285f99d44', 'request_id': 'req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:37.453179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836d671d99264c739052666285f99d44', 'request_id': 'req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:37.464225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] The token cache is being invalidate because project 836d671d99264c739052666285f99d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:37.464679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:37.466102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f6f48a8e-6650-46d9-bfe4-91d27e466d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:37.467370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 973/1958] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:37 2021] DELETE /identity/v3/projects/836d671d99264c739052666285f99d44 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:37.475577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.476071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.476339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.500083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:37.501389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.578415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 986/1959] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:37.587095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.587469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.587783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.621126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:37.622663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:37.636493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 974/1960] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:37.637950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.654824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf24b65-ca5d-48fc-b27d-b509bf1c53be None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.663230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.664409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.664685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.665081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.665902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:37.666224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.668380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.701914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 987/1961] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:37.706469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.718220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5665-df04-49c1-b900-55b7aa828fcf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.724078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.725044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.725520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.726384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.727556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.730592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.777855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 975/1962] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:37 2021] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:37.780679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.790992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b783dd4-1d2b-48a0-abe6-96f6d9612fd2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.864500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.865852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.866079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.866366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.867042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.869520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.905789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.911611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 988/1963] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:37 2021] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:37.918546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722c3e-db37-4bb1-8738-3bcbdb8a5b28 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.923599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.924546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.925035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.925808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.926740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.929242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:37.948791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 976/1964] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:37.949536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:37.963831 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655449e-71ec-48f2-8c6e-3ea6ab220809 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:37.983125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:37.984035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:37.984633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:37.985052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:37.985969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:37.987896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720595f8-2e6c-41f1-90ba-25eb8d0b16a9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.001403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 989/1965] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:38.005858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.019225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b4e5-ee07-49a3-9415-0e29eeb2ac23 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.024478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.026748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.027335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.027768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] PATH_INFO: `/v3/projects/7f8378c85fd5425a87b9a07f6c179024/users/42f315d7a2524790b096766923364233/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.053710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8378c85fd5425a87b9a07f6c179024, user_id=42f315d7a2524790b096766923364233, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.057681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.083462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 977/1966] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:38 2021] PUT /identity/v3/projects/7f8378c85fd5425a87b9a07f6c179024/users/42f315d7a2524790b096766923364233/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:38.095877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.096303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.096729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.150397 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] MFA Rules not processed for user `42f315d7a2524790b096766923364233`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:38.151581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:38.234206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 990/1967] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:38 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:38.238237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.314236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21067-36c1-4d5b-89ad-0d9c0813fdfc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.319363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.320599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.321068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.321490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.322357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.324463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.364898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 978/1968] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:38 2021] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:38.365541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.383408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc552d1-0868-4076-996c-cde41859d72c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.478845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.479602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.480011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.480427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.481180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.483545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.512996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 991/1969] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:38 2021] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:38.516946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.531214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23e545-6807-4d4f-8473-2da573ccc017 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.549826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.550462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.550820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.551104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.552021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.553721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.575866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 979/1970] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:38 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:38.580222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.590966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898fee-4951-40de-893a-9315f1f03a9e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.602778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.611291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.612863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.615058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] PATH_INFO: `/v3/projects/3e22441ab1284ff197b48b2f4dd17261/users/f924ace5d7c84cd68d8a824b95dcfe99/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.654856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e22441ab1284ff197b48b2f4dd17261, user_id=f924ace5d7c84cd68d8a824b95dcfe99, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.658409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.678727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 992/1971] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:38 2021] PUT /identity/v3/projects/3e22441ab1284ff197b48b2f4dd17261/users/f924ace5d7c84cd68d8a824b95dcfe99/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:38.682977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.693199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce652-ddf8-43fe-af33-c9206449d428 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.764341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.765369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.766153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.766652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.767804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.769690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f616028-f7cd-4f95-ad07-94d6d683ccda admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.781687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 980/1972] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:38 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:38.786206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:38.799690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574a6a-9240-4266-86a9-63488c628930 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:38.806025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:38.807844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.808590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.809352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] PATH_INFO: `/v3/projects/3e22441ab1284ff197b48b2f4dd17261/users/f924ace5d7c84cd68d8a824b95dcfe99/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.812498 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e22441ab1284ff197b48b2f4dd17261, user_id=f924ace5d7c84cd68d8a824b95dcfe99, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:38.815862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:38.845170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 993/1973] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:38 2021] PUT /identity/v3/projects/3e22441ab1284ff197b48b2f4dd17261/users/f924ace5d7c84cd68d8a824b95dcfe99/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:38.845483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:38.845783 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:38.846067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:38.902743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] MFA Rules not processed for user `f924ace5d7c84cd68d8a824b95dcfe99`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:38.904675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:39.007607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 981/1974] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:38 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:39.029978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:39.032667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:39.166800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f16394-b2b6-4967-9801-9369df9c58fb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:39.171921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:39.172599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:39.172891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:39.173260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:39.259127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:39.261629 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:39.276747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 994/1975] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:39 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:41.404632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:41.406870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:41.523781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45933186-3bdd-4abb-bc06-dc6153414068 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:41.530164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:41.531348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:41.531727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:41.532089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] PATH_INFO: `/v3/users/c35cae1650cb413085228c875d520085` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:41.533419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35cae1650cb413085228c875d520085)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:41.535496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:41.584925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35cae1650cb413085228c875d520085'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:41.595020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35cae1650cb413085228c875d520085'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:41.608978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35cae1650cb413085228c875d520085'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:41.609791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35cae1650cb413085228c875d520085'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:41.610516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35cae1650cb413085228c875d520085'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:41.624504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 982/1976] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:41 2021] DELETE /identity/v3/users/c35cae1650cb413085228c875d520085 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:41.977795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:41.992224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bca3-49ed-4a62-974c-479f9d14f6bb service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:42.071906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:42.072761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:42.073047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:42.073332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] PATH_INFO: `/v3/projects/06e8798c8123480ab308dd298431d030` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:42.074506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e8798c8123480ab308dd298431d030)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:42.076537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:42.142932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e8798c8123480ab308dd298431d030', 'request_id': 'req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.151351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e8798c8123480ab308dd298431d030', 'request_id': 'req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.163341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e8798c8123480ab308dd298431d030', 'request_id': 'req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.173177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] The token cache is being invalidate because project 06e8798c8123480ab308dd298431d030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:42.173459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.174093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.175554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 995/1977] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:41 2021] DELETE /identity/v3/projects/06e8798c8123480ab308dd298431d030 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:42.179610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:42.181205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:42.193605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a62c0-0481-4d42-913a-6b5b067c40d6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:42.256575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:42.257417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:42.257699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:42.257971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] PATH_INFO: `/v3/users/a7909bcb60024eb2acb280e7a97c33d4` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:42.259145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7909bcb60024eb2acb280e7a97c33d4)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:42.261489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:42.313556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7909bcb60024eb2acb280e7a97c33d4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.321684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7909bcb60024eb2acb280e7a97c33d4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.333628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7909bcb60024eb2acb280e7a97c33d4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.334429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7909bcb60024eb2acb280e7a97c33d4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.335028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ca36d8ed-ec5e-4961-85ca-8b75d5bceed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7909bcb60024eb2acb280e7a97c33d4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.348147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 983/1978] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:00:42 2021] DELETE /identity/v3/users/a7909bcb60024eb2acb280e7a97c33d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:00:42.596545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:42.598218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:42.619446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923a03-b2e3-4a6f-b422-d61bdb9c1fb8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:42.689300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:42.690421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:42.690709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:42.690991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] PATH_INFO: `/v3/projects/502cf3e5178742479040503a94daa56c` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:42.692327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502cf3e5178742479040503a94daa56c)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:42.694309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:42.748647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502cf3e5178742479040503a94daa56c', 'request_id': 'req-6deeb8cb-491c-42f6-a8a8-14520725aae4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.759765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502cf3e5178742479040503a94daa56c', 'request_id': 'req-6deeb8cb-491c-42f6-a8a8-14520725aae4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.773203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502cf3e5178742479040503a94daa56c', 'request_id': 'req-6deeb8cb-491c-42f6-a8a8-14520725aae4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.784860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] The token cache is being invalidate because project 502cf3e5178742479040503a94daa56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:00:42.785193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.785790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6deeb8cb-491c-42f6-a8a8-14520725aae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:00:42.787568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 996/1979] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:00:42 2021] DELETE /identity/v3/projects/502cf3e5178742479040503a94daa56c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:42.793739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:42.794786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:42.795254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:42.834445 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:42.836678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:42.942807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 984/1980] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:42.944367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:42.944729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:42.945015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:42.976216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:42.976216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:42.980560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 997/1981] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:42.985090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:42.995152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558955dc-2743-49f9-bf95-0f3643a82f65 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.000097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.000762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.001097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.001484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.002283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:00:43.002612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.004737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.018808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 985/1982] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:00:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:00:43.023474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.036131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477cc5-0a07-4875-80ae-d96d0cda979e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.041400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.042007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.042291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.042571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.043230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.045171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.076590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 998/1983] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:00:43 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:43.079229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.089849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacd9ca-0c61-4200-acc1-f6e9bd56d1dc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.166977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.167496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.167791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.168065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.168879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.170929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.194378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 986/1984] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:00:43 2021] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:00:43.198905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.209182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd53e-3bc9-4609-ae19-739ecb80340f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.213825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.214496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.214783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.215061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.215744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.217727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.228930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 999/1985] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:00:43.234458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.246206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5271-29c1-4c86-9eb7-fb11740b7385 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.251772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.252369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.252653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.252999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.254016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.255632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0718ea-20d8-46f8-8c67-9f769e5ea1a5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.266705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 987/1986] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:00:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:00:43.271158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.281688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5a6eb-817b-424a-8c5d-04214983938f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.286309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.287149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.287432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.287707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] PATH_INFO: `/v3/projects/890796d40715477d9acdd1a024bdb61b/users/81d99dfa97fa4b889a49a241e49764ad/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.308050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=890796d40715477d9acdd1a024bdb61b, user_id=81d99dfa97fa4b889a49a241e49764ad, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.311102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.326499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1000/1987] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:00:43 2021] PUT /identity/v3/projects/890796d40715477d9acdd1a024bdb61b/users/81d99dfa97fa4b889a49a241e49764ad/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:00:43.337828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.338220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.338641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.378600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] MFA Rules not processed for user `81d99dfa97fa4b889a49a241e49764ad`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:00:43.379806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:43.455779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 988/1988] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:00:43 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:00:43.466212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:43.468051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:43.537728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9585-8764-4a99-abc3-755270d0dc6b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:43.546506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:43.547196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:43.547493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:43.547775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:43.559086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:43.560762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:43.570347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1001/1989] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:43 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:47.780922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:47.782446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:47.795191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cefee-249c-4a73-8343-594bdc2fcbc8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:47.799750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:47.800376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:47.800662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:47.800934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:47.802989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:47.876225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:47.877730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:47.887534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 989/1990] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:47 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:00:48.605849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:00:48.619592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff880-84c0-49ac-bb84-d379e5fcf6bb service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:00:48.623798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:00:48.624745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:00:48.625205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:00:48.626071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:00:48.628325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:00:48.702828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:00:48.704317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e22f4-9e17-471f-94fa-7a0007fbbf1c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:00:48.714428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1002/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:00:48 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:10.172593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:10.284620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f3c40-d8fe-4367-b2eb-699b321e5a51 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:10.291508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:10.292530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:10.292993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:10.293345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] PATH_INFO: `/v3/users/81d99dfa97fa4b889a49a241e49764ad` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:10.294758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d99dfa97fa4b889a49a241e49764ad)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:10.296757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:10.358903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d99dfa97fa4b889a49a241e49764ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:10.371696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d99dfa97fa4b889a49a241e49764ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:10.387959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d99dfa97fa4b889a49a241e49764ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:10.389177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d99dfa97fa4b889a49a241e49764ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:10.390294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d99dfa97fa4b889a49a241e49764ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:10.407810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 990/1992] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:10 2021] DELETE /identity/v3/users/81d99dfa97fa4b889a49a241e49764ad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:10.412150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:10.413045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:10.413478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:10.445731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:10.447164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:10.530507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1003/1993] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:10.540261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:10.541849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:10.610201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e25a3-5b52-4c22-98c7-e03a9bd3bc61 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:10.631123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:10.631852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:10.632281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:10.632668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:10.648332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:10.650057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be19672-01d1-4dac-8b12-2b843950b89d service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:10.670370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 991/1994] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:11.180926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:11.182530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:11.195789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64475a2-0126-4c53-b646-82b1a4b0b176 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:11.200386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:11.201295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.201713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.202177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] PATH_INFO: `/v3/projects/890796d40715477d9acdd1a024bdb61b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.203620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=890796d40715477d9acdd1a024bdb61b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:11.205720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:11.260136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890796d40715477d9acdd1a024bdb61b', 'request_id': 'req-6169a983-b20e-43d3-b002-80a0ca3ad2dd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:11.290825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890796d40715477d9acdd1a024bdb61b', 'request_id': 'req-6169a983-b20e-43d3-b002-80a0ca3ad2dd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:11.307343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890796d40715477d9acdd1a024bdb61b', 'request_id': 'req-6169a983-b20e-43d3-b002-80a0ca3ad2dd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:11.320485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] The token cache is being invalidate because project 890796d40715477d9acdd1a024bdb61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:11.321007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:11.322253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-6169a983-b20e-43d3-b002-80a0ca3ad2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:11.326424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1004/1995] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:11 2021] DELETE /identity/v3/projects/890796d40715477d9acdd1a024bdb61b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:11.337814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.339018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.339848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.367936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:11.369249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:11.445118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 992/1996] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:11.452646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.453203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.453203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.488068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:11.489603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:11.499131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1005/1997] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:11.503913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:11.514956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff1c4-68d1-4934-be80-e8f1f91b045e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:11.530702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:11.531657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.532052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.532475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.533668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:11.534966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:11.538863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:11.572934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 993/1998] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:11.578366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:11.589674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b14f6-7f78-4045-a4c2-5f8672b38e68 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:11.603206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:11.603821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.604110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.604419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.605077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:11.607083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:11.663777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1006/1999] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:11 2021] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:11.668130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:11.682483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e3aa-c676-41cd-b0e8-8ee88b87c764 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:11.872089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:11.872777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.873116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.873317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.874028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:11.876013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:11.917085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 994/2000] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:11 2021] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:11.918579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:11.935133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b87d6-b6c0-4a4d-9f85-900cbdb5bd1a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:11.957006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:11.957934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:11.958362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:11.958945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:11.962357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:11.975269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.020960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1007/2001] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:11 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:12.021171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.029108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e209-1f92-43af-93eb-e3afee847c17 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.041723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.042701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.043283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.044372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.044483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.046548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.051780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.056041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.062002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a721c60-1989-49ab-9238-3b2e141dea92 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.066805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.067560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.068016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.068340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] PATH_INFO: `/v3/users/95ad5c90de5d48d4a4105f1947dc9943` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.069545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ad5c90de5d48d4a4105f1947dc9943)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.071591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.083709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 995/2002] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:12 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:12.087876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.102159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444203-b44b-43f2-bb0e-17db42747431 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.108351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.109412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.109786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.110101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] PATH_INFO: `/v3/projects/306daa81c2794164a38ae7bc3b322ef2/users/ec0fe7fa96d645ecbc1e50fb5595971d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.135996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306daa81c2794164a38ae7bc3b322ef2, user_id=ec0fe7fa96d645ecbc1e50fb5595971d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.141017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1f32-5843-4e01-abd5-f512cf3db0d3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.157496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ad5c90de5d48d4a4105f1947dc9943'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.167690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 996/2003] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:12 2021] PUT /identity/v3/projects/306daa81c2794164a38ae7bc3b322ef2/users/ec0fe7fa96d645ecbc1e50fb5595971d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:12.173296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59fc0-7203-4568-acbc-7eeb3d33da50 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.173600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59fc0-7203-4568-acbc-7eeb3d33da50 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.173885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59fc0-7203-4568-acbc-7eeb3d33da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.180056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ad5c90de5d48d4a4105f1947dc9943'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.211043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ad5c90de5d48d4a4105f1947dc9943'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.211827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ad5c90de5d48d4a4105f1947dc9943'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.211954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1af59fc0-7203-4568-acbc-7eeb3d33da50 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:12.212651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ad5c90de5d48d4a4105f1947dc9943'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.213106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1af59fc0-7203-4568-acbc-7eeb3d33da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.243931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1008/2004] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:12 2021] DELETE /identity/v3/users/95ad5c90de5d48d4a4105f1947dc9943 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:12.245801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.248545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.343078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 997/2005] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:12.344744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.345039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.345322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.371156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:12.372656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.406331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a29ce-9f30-402b-99ab-e46a5d20291d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.411557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.412752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.413123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.413412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] PATH_INFO: `/v3/users/bb7adc68cc5d47fea458da9232672087` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.416621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7adc68cc5d47fea458da9232672087)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.420826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.451243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 998/2006] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:12.452491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.461751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.494291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7adc68cc5d47fea458da9232672087'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.504280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7adc68cc5d47fea458da9232672087'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.520893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7adc68cc5d47fea458da9232672087'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.522897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7adc68cc5d47fea458da9232672087'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.523518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7adc68cc5d47fea458da9232672087'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:12.537894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1009/2007] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:12 2021] DELETE /identity/v3/users/bb7adc68cc5d47fea458da9232672087 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:12.539069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.552985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690488b-3194-4013-bee5-59a2a8afc325 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.553950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.650134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf3613-49ef-4eba-9126-2b78c1f46996 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.655243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.656261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.656869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.657452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.660315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.674393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.675058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.675355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.675791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.684151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.760999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.762480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.778945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1010/2008] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:12.832712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.834160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bca84-1a8a-4178-933d-03a6e0cd4ebf service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:12.852902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 999/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:12.895157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:12.897760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:12.918562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634758-8411-418c-8635-f2e15f8fe1c2 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:12.932098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:12.933157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:12.933448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:12.933784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] PATH_INFO: `/v3/projects/7d153c67e84449bb8eb36b752ec41896` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:12.935636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d153c67e84449bb8eb36b752ec41896)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:12.938951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.058762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d153c67e84449bb8eb36b752ec41896', 'request_id': 'req-1693de42-bc79-4ac8-9a35-f4c29e7fc839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.071050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d153c67e84449bb8eb36b752ec41896', 'request_id': 'req-1693de42-bc79-4ac8-9a35-f4c29e7fc839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.098784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d153c67e84449bb8eb36b752ec41896', 'request_id': 'req-1693de42-bc79-4ac8-9a35-f4c29e7fc839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.116034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] The token cache is being invalidate because project 7d153c67e84449bb8eb36b752ec41896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:13.116619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.117549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1693de42-bc79-4ac8-9a35-f4c29e7fc839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.120051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1011/2010] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:12 2021] DELETE /identity/v3/projects/7d153c67e84449bb8eb36b752ec41896 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:13.126427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.126730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.127051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.153970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:13.155309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:13.231242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1000/2011] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:13.239819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.240128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.240446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.281949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:13.285096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:13.308488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1012/2012] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:13.309792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.328008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bbf1-fde7-4882-84fa-0671f0a3e166 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.336642 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.337246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.337529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.337804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.338650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:13.338971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.347809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.368589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1001/2013] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:13.373108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.390663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10708d-9f1c-48e6-8db4-7564db4dddde None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.410163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.410769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.411051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.411343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.411994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.414080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.475192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1013/2014] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:13 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:13.480917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.497073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb165-9a75-43a1-bbad-1977151e3100 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.589079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.591394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:13.600340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.601250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.603311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.603599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.604597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.608466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.642256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1002/2015] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:13 2021] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:13.647135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.661371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc96fd-5753-4582-8f9d-c52ac4aab577 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.673508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.674460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.675422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.675704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.676436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.679179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.683694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347393c-d22f-45f3-b83b-6593805b4b72 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.689221 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.690264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1003/2016] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:13.690691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.691214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.691502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] PATH_INFO: `/v3/projects/8549da5be8454b71bdacfd7a2d9b29ac` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.693405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8549da5be8454b71bdacfd7a2d9b29ac)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.694820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.696088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.707325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d597-fa7b-41d8-b79b-6cb883625944 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.712468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.714372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.715062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.715349 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.716383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.718182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.748290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1004/2017] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:13.749710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.764791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710697-6a6f-4598-ad32-6b1946622eee admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.775784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8549da5be8454b71bdacfd7a2d9b29ac', 'request_id': 'req-7ba85310-f53d-498f-b8d3-b5f2082070ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.796796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8549da5be8454b71bdacfd7a2d9b29ac', 'request_id': 'req-7ba85310-f53d-498f-b8d3-b5f2082070ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.813890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8549da5be8454b71bdacfd7a2d9b29ac', 'request_id': 'req-7ba85310-f53d-498f-b8d3-b5f2082070ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.835913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] The token cache is being invalidate because project 8549da5be8454b71bdacfd7a2d9b29ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:13.836417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.848792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.851018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1014/2018] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:13 2021] DELETE /identity/v3/projects/8549da5be8454b71bdacfd7a2d9b29ac => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:13.854810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:13.856680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:13.862431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.863947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.864420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.864903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] PATH_INFO: `/v3/projects/47492ce2421549ca8cbf925bbe0ead1c/users/965cf2736589449e8929672c247255e1/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.886233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba85310-f53d-498f-b8d3-b5f2082070ce admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:13.891488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:13.891820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47492ce2421549ca8cbf925bbe0ead1c, user_id=965cf2736589449e8929672c247255e1, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.892326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.892611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.893081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] PATH_INFO: `/v3/users/93e92c186ed6405385b4475b20827498` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.894809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e92c186ed6405385b4475b20827498)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:13.895663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902aef-b9aa-44e7-8e91-841ee3f6746d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.898373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:13.923365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1005/2019] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:13 2021] PUT /identity/v3/projects/47492ce2421549ca8cbf925bbe0ead1c/users/965cf2736589449e8929672c247255e1/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:13.933958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3720-c892-400f-86e1-c88396abc858 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:13.935039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3720-c892-400f-86e1-c88396abc858 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:13.935410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3720-c892-400f-86e1-c88396abc858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:13.968547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e92c186ed6405385b4475b20827498'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.980101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e92c186ed6405385b4475b20827498'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.995194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e92c186ed6405385b4475b20827498'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.997784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e92c186ed6405385b4475b20827498'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:13.998619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e92c186ed6405385b4475b20827498'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.006767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-124a3720-c892-400f-86e1-c88396abc858 None None] MFA Rules not processed for user `965cf2736589449e8929672c247255e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:14.008935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-124a3720-c892-400f-86e1-c88396abc858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.017163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1015/2020] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:13 2021] DELETE /identity/v3/users/93e92c186ed6405385b4475b20827498 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:14.133862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1006/2021] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:13 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:14.141044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.144891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.309526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f97a-bbcf-40dc-add1-599bdc48e0be admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.314741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.315436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.315738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.316020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.316751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.318978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.335392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.335685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.335961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.351434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1016/2022] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:14 2021] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:14.355116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.382805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] MFA Rules not processed for user `ec0fe7fa96d645ecbc1e50fb5595971d`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:14.384977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.484041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1007/2023] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:14 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:14.491223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.492682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5e62-8aab-4723-9fd6-bf1dbc4bf96b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.493211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.498641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.499491 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.499926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.500409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.501220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.503612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.531638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1017/2024] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:14 2021] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:14.535420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.549020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a4089-e5b4-472c-881b-50797b418401 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.553891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.554643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.555025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.555400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.556267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.558411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.572379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1018/2025] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:14.576802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.588268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee27c87-8718-4240-aa95-75762ed31a45 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.593423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.594277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.594561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.594842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] PATH_INFO: `/v3/projects/0098df62fd5a45a38c87c709411c18cc/users/220fb8557000465ebc37e09eac70e89e/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.612069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e1cc-e506-46a1-b150-53d941d34119 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.615760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0098df62fd5a45a38c87c709411c18cc, user_id=220fb8557000465ebc37e09eac70e89e, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.616444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.617391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.617895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.618394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.618618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.631924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.633824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.646024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1019/2026] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:14 2021] PUT /identity/v3/projects/0098df62fd5a45a38c87c709411c18cc/users/220fb8557000465ebc37e09eac70e89e/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:14.646221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1008/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:14 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:14.646316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.647205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.648087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.660979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69693ab-82cd-44d0-bc2b-00cfde94142a service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.730878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a57835-8208-4649-ac78-e02e3ef43e54 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.736962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.739643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.739643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.739865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] PATH_INFO: `/v3/projects/7194a650fc964078bd302338e4a88432` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.740905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7194a650fc964078bd302338e4a88432)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.742863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.751075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.752661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.753278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.754222 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.755040 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.757366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.772036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1009/2028] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:14 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:14.776364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:14.789895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0264b-07df-45a4-b1f2-d9796809d4c3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:14.795294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:14.795839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.796231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.796630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] PATH_INFO: `/v3/projects/0098df62fd5a45a38c87c709411c18cc/users/220fb8557000465ebc37e09eac70e89e/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.798589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0098df62fd5a45a38c87c709411c18cc, user_id=220fb8557000465ebc37e09eac70e89e, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:14.801398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42799e84-a108-4ce0-9501-377886ede9f9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:14.813399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1010/2029] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:14 2021] PUT /identity/v3/projects/0098df62fd5a45a38c87c709411c18cc/users/220fb8557000465ebc37e09eac70e89e/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:14.824002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528a49-c329-433c-aa83-e155e462607b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.824446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528a49-c329-433c-aa83-e155e462607b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.825127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528a49-c329-433c-aa83-e155e462607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.838560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7194a650fc964078bd302338e4a88432', 'request_id': 'req-80f923d5-36d9-4663-8c00-8ab57abee665'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.854253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7194a650fc964078bd302338e4a88432', 'request_id': 'req-80f923d5-36d9-4663-8c00-8ab57abee665'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.884413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7194a650fc964078bd302338e4a88432', 'request_id': 'req-80f923d5-36d9-4663-8c00-8ab57abee665'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.898045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] The token cache is being invalidate because project 7194a650fc964078bd302338e4a88432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:14.898692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.899666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-80f923d5-36d9-4663-8c00-8ab57abee665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:14.901967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1020/2030] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:14 2021] DELETE /identity/v3/projects/7194a650fc964078bd302338e4a88432 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:14.911848 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6ca3-cf54-41ae-94f3-ed6fd8462a77 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:14.912177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6ca3-cf54-41ae-94f3-ed6fd8462a77 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:14.913734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4f528a49-c329-433c-aa83-e155e462607b None None] MFA Rules not processed for user `220fb8557000465ebc37e09eac70e89e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:14.914917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4f528a49-c329-433c-aa83-e155e462607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:14.917474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6ca3-cf54-41ae-94f3-ed6fd8462a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:14.990157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d49b6ca3-cf54-41ae-94f3-ed6fd8462a77 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:14.991394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d49b6ca3-cf54-41ae-94f3-ed6fd8462a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.033145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1011/2031] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:14 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:15.039050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528a49-c329-433c-aa83-e155e462607b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.040807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4f528a49-c329-433c-aa83-e155e462607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.103638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1021/2032] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:15.105378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.106160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.106548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.144755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:15.146894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.157885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1022/2033] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:15.162090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.175002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756112d3-6fa1-460a-98b2-7758df978f64 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.182635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.183472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.183845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.185171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528a49-c329-433c-aa83-e155e462607b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.188609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.189521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:15.189982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.190389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.191504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.191932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.192341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.192540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] PATH_INFO: `/v3/users/965cf2736589449e8929672c247255e1` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.194286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965cf2736589449e8929672c247255e1)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.196725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.236589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1023/2034] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:15.237755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.253909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b54f-4c88-4a8e-bf2e-6b4d39bb79da admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.267232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.267232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.267232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.267232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.267749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.267749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.267891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965cf2736589449e8929672c247255e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:15.275551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965cf2736589449e8929672c247255e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:15.289337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965cf2736589449e8929672c247255e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:15.290106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965cf2736589449e8929672c247255e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:15.290956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-24e9b733-8a76-4b12-a94d-c738977dbe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965cf2736589449e8929672c247255e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:15.296865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1024/2035] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:15 2021] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:15.300865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.302412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.308125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1012/2036] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:15 2021] DELETE /identity/v3/users/965cf2736589449e8929672c247255e1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:15.313065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.313442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.313641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.336067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:15.337420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.386345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b904f-4e0f-4b68-9fcd-b13e8995a6ec admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.415437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1013/2037] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:15.423342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.424722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.462350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.462977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.463266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.464035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.464747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.467431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.498891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1025/2038] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:15 2021] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:15.503589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.515755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d340d9-c023-4d70-9fe1-ca8d76896cb6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.521340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.522094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.522484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.522889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.523853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.525678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.535824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d7d63-bfcd-458f-8e01-214471c51140 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.538114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1026/2039] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:15 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:15.541946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.542348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.542953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.543244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.543525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.553948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.555389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6d90-c319-4be6-8b41-1d4f74a27612 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.555580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.561493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.561688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.561981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.562266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.562985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.564676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88844448-bf24-4b56-a3a9-e04b3dca82ba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.566496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1014/2040] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:15.582535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1027/2041] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:15 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:15.583556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.593128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837a300-2384-452e-a8d4-c57ee87a3b6d service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.597768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.598580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.598871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.599147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] PATH_INFO: `/v3/projects/5af3e162dcdd41b88b23a614c94ab2ba/users/d5186793024c4be0974807f53eb5db03/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.618563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af3e162dcdd41b88b23a614c94ab2ba, user_id=d5186793024c4be0974807f53eb5db03, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.621287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.636490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1015/2042] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:15 2021] PUT /identity/v3/projects/5af3e162dcdd41b88b23a614c94ab2ba/users/d5186793024c4be0974807f53eb5db03/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:15.649004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.649540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.649654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.687762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] MFA Rules not processed for user `d5186793024c4be0974807f53eb5db03`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:15.688990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.765103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1028/2043] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:15 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:15.776125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.777850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:15.847503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781232-5487-495c-a262-328b7d88c470 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:15.851081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:15.852176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:15.852480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:15.852763 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:15.863322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:15.865787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:15.875903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1016/2044] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:15 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:15.957496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:15.963145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:16.039401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c3cfe-c087-4325-8be7-bfeaa76e3907 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:16.044395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:16.045153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:16.045439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:16.045714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] PATH_INFO: `/v3/projects/47492ce2421549ca8cbf925bbe0ead1c` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:16.046852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=47492ce2421549ca8cbf925bbe0ead1c)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:16.048792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:16.099682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47492ce2421549ca8cbf925bbe0ead1c', 'request_id': 'req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.106390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47492ce2421549ca8cbf925bbe0ead1c', 'request_id': 'req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.118643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47492ce2421549ca8cbf925bbe0ead1c', 'request_id': 'req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.131076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] The token cache is being invalidate because project 47492ce2421549ca8cbf925bbe0ead1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:16.131380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.132084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.134204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1029/2045] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:15 2021] DELETE /identity/v3/projects/47492ce2421549ca8cbf925bbe0ead1c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:16.138882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:16.150501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402e93-67a9-4840-83ff-4052156c8871 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:16.214935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:16.215824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:16.216203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:16.216426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] PATH_INFO: `/v3/users/220fb8557000465ebc37e09eac70e89e` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:16.217526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220fb8557000465ebc37e09eac70e89e)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:16.219433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:16.281861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220fb8557000465ebc37e09eac70e89e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.297436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220fb8557000465ebc37e09eac70e89e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.316719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220fb8557000465ebc37e09eac70e89e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.317558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220fb8557000465ebc37e09eac70e89e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.318207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b6eec35b-24d2-447d-9827-06c4c7b9d620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220fb8557000465ebc37e09eac70e89e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:16.334256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1017/2046] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:16 2021] DELETE /identity/v3/users/220fb8557000465ebc37e09eac70e89e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:16.854024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:16.855538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:16.870552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd154d-717e-4658-96d5-5f5e9cb2d5fa admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:16.937368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:16.938325 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:16.938923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:16.939213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] PATH_INFO: `/v3/projects/0098df62fd5a45a38c87c709411c18cc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:16.940418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0098df62fd5a45a38c87c709411c18cc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:16.942323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:16.997351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0098df62fd5a45a38c87c709411c18cc', 'request_id': 'req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:17.006830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0098df62fd5a45a38c87c709411c18cc', 'request_id': 'req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:17.018568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0098df62fd5a45a38c87c709411c18cc', 'request_id': 'req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:17.028852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] The token cache is being invalidate because project 0098df62fd5a45a38c87c709411c18cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:17.029129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:17.029812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-207f3b8e-afce-4c7e-8bff-95f39e15c4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:17.031317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1030/2047] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:16 2021] DELETE /identity/v3/projects/0098df62fd5a45a38c87c709411c18cc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:17.038329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.039002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.039188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.072546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:17.073988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:17.156979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1018/2048] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:17.166128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.166425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.166763 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.197858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:17.199020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:17.206820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1031/2049] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:17.211391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.220901 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021663-3870-4f3d-ac87-ada247ff77b2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.225870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.226448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.226736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.227012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.227689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:17.227987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.229607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.242463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1019/2050] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:17.246817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.261285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650158fd-25a5-49ea-98ea-b0931c7c0aac None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.270199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.271068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.271439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.271873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.273031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.275940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.310266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1032/2051] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:17.314747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.325042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490b32b-75e7-4d7f-a755-2387f35f5126 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.401311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.401908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.402191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.402467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.403130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.405291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.427909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1020/2052] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:17.432426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.444099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466cb16-130e-4309-8bee-93002c77ae08 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.449608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.450371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.450697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.450986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.451690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.453349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.467799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1033/2053] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:17.469145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.479628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389c19b-d508-46ea-9060-d09090dfe9f2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.485905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.486581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.486934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.487424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.488226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.490133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84ad5-0c19-4e5d-ac80-8bf4a2fbba1d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.505805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1021/2054] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:17.509960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.520174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c3b9-dbea-474b-9f1f-48ce0b7639db admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.524807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.525650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.525937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.526218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] PATH_INFO: `/v3/projects/aea3afe9cbf849dfbce3a41e492dc07d/users/7d727be12b524791ab2a60e0625f7ab8/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.546538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea3afe9cbf849dfbce3a41e492dc07d, user_id=7d727be12b524791ab2a60e0625f7ab8, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.549339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.563176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1034/2055] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:17 2021] PUT /identity/v3/projects/aea3afe9cbf849dfbce3a41e492dc07d/users/7d727be12b524791ab2a60e0625f7ab8/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:17.573753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.574128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.574426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.611172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] MFA Rules not processed for user `7d727be12b524791ab2a60e0625f7ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:17.612382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:17.691031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1022/2056] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:17.695341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.765647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000bc2-2d34-4822-90b3-b4cd16fb7a8b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.772149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.772937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.773758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.774125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.774878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.777382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.806069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1035/2057] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:17.810235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.820651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145ecdf-4805-48c1-a38a-813a692bc6b5 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.886839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.887462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.887950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.888173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.888794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.891261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.912720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1023/2058] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:17 2021] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:17.916733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.927710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29d5b-91d5-4f06-b60b-1385fbccead2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.932610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.933257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.933547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.933821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.935735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.936261 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:17.948749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1036/2059] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:17.953794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:17.964216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99c5d0-cb73-487d-a12a-0ef6c6bfd875 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:17.969145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:17.970115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:17.970402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:17.970821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] PATH_INFO: `/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5/users/c8abd1e71c4e4f89a09881bd09f0e629/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:17.994868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb9cbf7cfc046c28b1605dc6015cec5, user_id=c8abd1e71c4e4f89a09881bd09f0e629, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:17.997699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.012994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1024/2060] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:17 2021] PUT /identity/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5/users/c8abd1e71c4e4f89a09881bd09f0e629/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:18.017120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:18.026975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90f25-a563-4f98-9b23-bf1b5938416f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:18.097063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:18.097667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.098046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.098232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.098921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:18.100608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0487c-cf76-41fe-9d37-ab7b098c44e7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.111438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1037/2061] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:18 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:18.115639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:18.126329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2495-e158-48f9-a045-32df6315ef31 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:18.131458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:18.132280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.132581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.132855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] PATH_INFO: `/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5/users/c8abd1e71c4e4f89a09881bd09f0e629/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.134688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb9cbf7cfc046c28b1605dc6015cec5, user_id=c8abd1e71c4e4f89a09881bd09f0e629, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:18.137310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.148181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1025/2062] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:18 2021] PUT /identity/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5/users/c8abd1e71c4e4f89a09881bd09f0e629/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:18.160128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.160467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.160781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.198358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] MFA Rules not processed for user `c8abd1e71c4e4f89a09881bd09f0e629`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:18.199528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:18.278793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1038/2063] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:18 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:18.289358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:18.291551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:18.360044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b10c4-2b45-4418-b997-ec567a6b4bda admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:18.364878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:18.365424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.365743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.366021 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.376473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:18.378217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae610a0-2f13-4521-a317-2b1fcf5c47d9 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.388247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1026/2064] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:18 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:18.454463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:18.537759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2c4e-0c59-4e86-b96c-f783ed0be2e4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:18.544255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:18.545080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.545361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.545680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] PATH_INFO: `/v3/users/7d727be12b524791ab2a60e0625f7ab8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.546866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d727be12b524791ab2a60e0625f7ab8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:18.548814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.617278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d727be12b524791ab2a60e0625f7ab8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:18.624908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d727be12b524791ab2a60e0625f7ab8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:18.636893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d727be12b524791ab2a60e0625f7ab8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:18.637563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d727be12b524791ab2a60e0625f7ab8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:18.638203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d727be12b524791ab2a60e0625f7ab8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:18.651063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1039/2065] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:18 2021] DELETE /identity/v3/users/7d727be12b524791ab2a60e0625f7ab8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:18.655857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.656224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.656444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.680498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:18.681651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:18.747452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1027/2066] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:18.760158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:18.763078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:18.843129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59540-c2bb-43bc-a7ff-019f4767bf85 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:18.848998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:18.850816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:18.851327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:18.852014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:18.864511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:18.866279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:18.877567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1040/2067] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:19.497600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:19.499546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:19.512025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6e3c2-3e9c-4745-b0a2-913af9f4f5dc None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:19.519097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:19.519980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:19.521594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:19.522069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] PATH_INFO: `/v3/projects/aea3afe9cbf849dfbce3a41e492dc07d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:19.523717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea3afe9cbf849dfbce3a41e492dc07d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:19.525857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:19.596712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea3afe9cbf849dfbce3a41e492dc07d', 'request_id': 'req-9d681421-79d9-4799-bf75-2f29a5cc159d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.613825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea3afe9cbf849dfbce3a41e492dc07d', 'request_id': 'req-9d681421-79d9-4799-bf75-2f29a5cc159d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.642491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea3afe9cbf849dfbce3a41e492dc07d', 'request_id': 'req-9d681421-79d9-4799-bf75-2f29a5cc159d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.654867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] The token cache is being invalidate because project aea3afe9cbf849dfbce3a41e492dc07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:19.655156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.655827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.659306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1028/2068] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:19 2021] DELETE /identity/v3/projects/aea3afe9cbf849dfbce3a41e492dc07d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:19.663528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:19.675040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68200682-2913-4e56-976b-36ce4126f58a service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:19.765852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:19.766915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:19.767034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:19.767290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] PATH_INFO: `/v3/users/c8abd1e71c4e4f89a09881bd09f0e629` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:19.768897 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8abd1e71c4e4f89a09881bd09f0e629)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:19.771616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:19.858782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8abd1e71c4e4f89a09881bd09f0e629'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.871632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8abd1e71c4e4f89a09881bd09f0e629'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.885737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8abd1e71c4e4f89a09881bd09f0e629'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.886579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8abd1e71c4e4f89a09881bd09f0e629'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.887214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e756f7bb-2126-4e2f-b438-77c3f4a22e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8abd1e71c4e4f89a09881bd09f0e629'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:19.902681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1041/2069] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:19 2021] DELETE /identity/v3/users/c8abd1e71c4e4f89a09881bd09f0e629 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:20.327537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:20.329205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:20.343220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681421-79d9-4799-bf75-2f29a5cc159d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:20.415058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:20.416058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.416388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.416707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] PATH_INFO: `/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.417864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb9cbf7cfc046c28b1605dc6015cec5)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:20.420791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:20.498110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb9cbf7cfc046c28b1605dc6015cec5', 'request_id': 'req-40b05b2e-5d6d-4566-aa56-72695fc42d0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:20.506931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb9cbf7cfc046c28b1605dc6015cec5', 'request_id': 'req-40b05b2e-5d6d-4566-aa56-72695fc42d0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:20.519990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb9cbf7cfc046c28b1605dc6015cec5', 'request_id': 'req-40b05b2e-5d6d-4566-aa56-72695fc42d0a'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:20.530954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] The token cache is being invalidate because project 5bb9cbf7cfc046c28b1605dc6015cec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:20.531235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:20.531914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40b05b2e-5d6d-4566-aa56-72695fc42d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:20.533424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1029/2070] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:20 2021] DELETE /identity/v3/projects/5bb9cbf7cfc046c28b1605dc6015cec5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:20.541297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.541592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.541875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.567814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:20.569523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:20.644026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1042/2071] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:20.651898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.652187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.652500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.675778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:20.677020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:20.686708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1030/2072] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:20.691283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:20.701223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3865a9-fab3-4ca4-93d8-ef660c10be1b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:20.721307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:20.722398 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.722889 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.723407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.724495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:20.725133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:20.727531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03dd4b-f3e3-4509-adb1-dd78c9a8d747 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:20.744405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1043/2073] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:20.748803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:20.760918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c453dc0-e932-4ce3-8585-4decf08ed892 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:20.766386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:20.768337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.768731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.769073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.770388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:20.786192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:20.828112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:20.828961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:20.829441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:20.879372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] MFA Rules not processed for user `ec0fe7fa96d645ecbc1e50fb5595971d`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:20.879959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1031/2074] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:20 2021] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:20.881412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:20.884507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.003692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3d53-8bf2-4e67-aad9-bb2934a2f5ef admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.009802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.010721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.011046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1044/2075] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:20 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:21.011565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.011998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.013098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.015462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.054027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1032/2076] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:20 2021] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:21.058172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.075850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22e165-f628-4a48-813e-df1fb1a4c79f None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.082693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.083480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.084022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.084460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.085835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.087908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.113382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1045/2077] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:21.113628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.124505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df7a9-de24-4e2c-8e78-622648930d5f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.142767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.143377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.143659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.143938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.144670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.146273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e890feb-6646-440b-8c46-69d3cce4ee8a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.170968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1033/2078] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:21.175599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.190951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af75b3a-368d-40b6-a2f7-4407ac93ee97 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.197164 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.198034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.198326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.198608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] PATH_INFO: `/v3/projects/16a52c7a274541948a97f6e4a593f313/users/fe55ca64203e4875bd86c6b440330b25/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.222263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a52c7a274541948a97f6e4a593f313, user_id=fe55ca64203e4875bd86c6b440330b25, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.225407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.244154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1046/2079] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:21 2021] PUT /identity/v3/projects/16a52c7a274541948a97f6e4a593f313/users/fe55ca64203e4875bd86c6b440330b25/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:21.255469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.256083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.256537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.307495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] MFA Rules not processed for user `fe55ca64203e4875bd86c6b440330b25`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:21.308727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:21.487956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1034/2080] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:21 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:21.492854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.611343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd7da0-a7bb-4114-ac83-2ec8496447d8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.633479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.634292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.634661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.635022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.635785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.638660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.680034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1047/2081] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:21 2021] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:21.684066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.698435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bbd2c-b7d8-4118-b705-c3780ae254bb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.828736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.829341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.829872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.830306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.831123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.834163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.872364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1035/2082] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:21 2021] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:21.877553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.892713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8bae-b7f7-449a-8ad6-8d064455170e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.903870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.905057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.905490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.906483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.907361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.909597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338331d-fc05-4c15-bb7b-b29658ff0fb5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:21.923802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1048/2083] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:21.936264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:21.946430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.946839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.947225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.952971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7532-5569-4527-a406-f49955f1e9dd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:21.958129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:21.959643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:21.959928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:21.960538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] PATH_INFO: `/v3/projects/eb48ba04242b426ea989da5dc33ed2fa/users/f69c9674a51c45fea0495dfd7446818b/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:21.984851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] MFA Rules not processed for user `c023f89fd3da4bc8b38963bed4e5cc63`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:21.986427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb48ba04242b426ea989da5dc33ed2fa, user_id=f69c9674a51c45fea0495dfd7446818b, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:21.987890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:21.991604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:22.012124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1036/2084] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:21 2021] PUT /identity/v3/projects/eb48ba04242b426ea989da5dc33ed2fa/users/f69c9674a51c45fea0495dfd7446818b/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:22.013459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:22.100738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1049/2085] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:21 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:22.149163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337010-b55d-4986-aedc-135f7270033b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:22.154703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:22.156189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:22.156748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:22.157096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:22.158669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:22.161096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6b41-0b2c-4267-a4b7-13024cd04a28 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:22.184285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1037/2086] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:22 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:22.186316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:22.199346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880290c-70da-4d57-856e-f5e1c9f97663 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:22.205475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:22.206658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:22.207341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:22.207726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] PATH_INFO: `/v3/projects/eb48ba04242b426ea989da5dc33ed2fa/users/f69c9674a51c45fea0495dfd7446818b/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:22.212634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb48ba04242b426ea989da5dc33ed2fa, user_id=f69c9674a51c45fea0495dfd7446818b, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:22.215502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:22.243161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1050/2087] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:22 2021] PUT /identity/v3/projects/eb48ba04242b426ea989da5dc33ed2fa/users/f69c9674a51c45fea0495dfd7446818b/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:22.256766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:22.257057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:22.257341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:22.310453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] MFA Rules not processed for user `f69c9674a51c45fea0495dfd7446818b`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:22.312149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:22.417118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1038/2088] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:22 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:22.428446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:22.430424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:22.511991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3703a9-e0e6-43e6-a959-1fb275dc3d67 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:22.516213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:22.517322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:22.517706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:22.518167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:22.528825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:22.530447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:22.542695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1051/2089] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:22 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:22.670259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:22.686598 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3308-4eb1-4afc-8456-c1127d0070f0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:22.691378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:22.692189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:22.692697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:22.693126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:22.775238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:22.777184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bed687-aaf3-4e69-af25-88c3003b3d30 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:22.800717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1039/2090] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:22 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:31.504391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:31.582087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f317fb-8a59-49a7-9074-2e04496ea634 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:31.586631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:31.587553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:31.588207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:31.588552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] PATH_INFO: `/v3/users/fe55ca64203e4875bd86c6b440330b25` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:31.589780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe55ca64203e4875bd86c6b440330b25)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:31.592544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:31.655348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe55ca64203e4875bd86c6b440330b25'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:31.675409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe55ca64203e4875bd86c6b440330b25'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:31.701804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe55ca64203e4875bd86c6b440330b25'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:31.704559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe55ca64203e4875bd86c6b440330b25'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:31.706358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe55ca64203e4875bd86c6b440330b25'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:31.739940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1052/2091] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:31 2021] DELETE /identity/v3/users/fe55ca64203e4875bd86c6b440330b25 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:31.744782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:31.745316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:31.745811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:31.789235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:31.792880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:31.914752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1040/2092] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:31.950017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:31.951455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:32.084561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5a5e-7a5b-4ece-8467-deb928d435d3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:32.092883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:32.093515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:32.093818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:32.094139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:32.115764 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:32.119796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:32.142973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1053/2093] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:33.228940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:33.230402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:33.248880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eae3c4-5dce-4ce7-935f-82a4c43e04af None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:33.260638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:33.261660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:33.262355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:33.262907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] PATH_INFO: `/v3/projects/16a52c7a274541948a97f6e4a593f313` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:33.265393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a52c7a274541948a97f6e4a593f313)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:33.269019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:33.361575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a52c7a274541948a97f6e4a593f313', 'request_id': 'req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.374285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a52c7a274541948a97f6e4a593f313', 'request_id': 'req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.391156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a52c7a274541948a97f6e4a593f313', 'request_id': 'req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.404976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] The token cache is being invalidate because project 16a52c7a274541948a97f6e4a593f313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:33.405393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.406160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.408290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1041/2094] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:33 2021] DELETE /identity/v3/projects/16a52c7a274541948a97f6e4a593f313 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:33.411983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:33.426700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafa08-1140-43df-ba3a-424c722a3225 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:33.507208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:33.508387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:33.508682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:33.508965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] PATH_INFO: `/v3/users/f69c9674a51c45fea0495dfd7446818b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:33.510332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69c9674a51c45fea0495dfd7446818b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:33.512415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:33.590868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69c9674a51c45fea0495dfd7446818b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.615553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69c9674a51c45fea0495dfd7446818b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.657254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69c9674a51c45fea0495dfd7446818b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.658026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69c9674a51c45fea0495dfd7446818b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.658645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b98bcddb-73d7-4b73-9129-71042348e000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69c9674a51c45fea0495dfd7446818b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:33.685684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1054/2095] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:33 2021] DELETE /identity/v3/users/f69c9674a51c45fea0495dfd7446818b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:34.929045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:34.930429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:34.955020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f3be-87df-4a7f-bf34-2cbbc4a42761 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:34.988600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:34.989489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:34.989938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.033841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:35.035347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.071773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.073166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.073678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.074190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] PATH_INFO: `/v3/projects/eb48ba04242b426ea989da5dc33ed2fa` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.076526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb48ba04242b426ea989da5dc33ed2fa)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.081167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.185676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb48ba04242b426ea989da5dc33ed2fa', 'request_id': 'req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.214916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb48ba04242b426ea989da5dc33ed2fa', 'request_id': 'req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.240804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1055/2096] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:01:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:35.241312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb48ba04242b426ea989da5dc33ed2fa', 'request_id': 'req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.243484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.245843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.272214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8071aa-4da8-4487-af37-a77435c4daca None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:35.283136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] The token cache is being invalidate because project eb48ba04242b426ea989da5dc33ed2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:35.283560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.288194 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d7f32cba-f97b-4c20-806b-bba0a79ea7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.289984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1042/2097] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:34 2021] DELETE /identity/v3/projects/eb48ba04242b426ea989da5dc33ed2fa => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:35.295995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.296306 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.296706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.363469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:35.366924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.412887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.414666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.415192 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.430621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] PATH_INFO: `/v3/users/42f315d7a2524790b096766923364233` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.433437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f315d7a2524790b096766923364233)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.437213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.482027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1043/2098] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:35.483252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.484564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.522432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f315d7a2524790b096766923364233'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.532462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f315d7a2524790b096766923364233'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.551624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f315d7a2524790b096766923364233'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.553183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f315d7a2524790b096766923364233'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.554439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-de0586fd-6fbe-4e6e-bc91-a7c72216b242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f315d7a2524790b096766923364233'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:35.572476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1056/2099] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:35 2021] DELETE /identity/v3/users/42f315d7a2524790b096766923364233 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:35.578054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62727532-21fa-4a3e-9259-58bbaecdcf4a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.578435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62727532-21fa-4a3e-9259-58bbaecdcf4a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.578786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62727532-21fa-4a3e-9259-58bbaecdcf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.582821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049134b-3b71-4238-a3b1-a0669860edfd None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:35.613724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-62727532-21fa-4a3e-9259-58bbaecdcf4a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:35.615434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-62727532-21fa-4a3e-9259-58bbaecdcf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.674750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.675653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.676034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.676450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.678809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.717400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1057/2100] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:35.719252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.719252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.719566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.750705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:35.753285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.763828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.764071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1058/2101] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:35.765780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.769182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.781856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1044/2102] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:01:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:35.782981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.785460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:35.785977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945f4a6-61f0-45a1-8fa4-39ae597b30cf None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:35.799445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.800832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.801303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.802068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.803172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:35.822715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.828112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.857750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1059/2103] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:35.863538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.879324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53389f-2df2-4ed1-bfbe-de6291036ff6 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:35.884829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.885637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.886234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.886653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.887628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.890207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.916380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b5127-baaa-486a-ae86-9aa5ce228894 service swift] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:35.926232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:35.926891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:35.927146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:35.927424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:35.937592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1060/2104] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:35 2021] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:35.939339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:35.954583 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:35.960227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:35.978076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1045/2105] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:36.039900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de936e-cc5e-4028-b144-a586ac3b66ed admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.044993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.045761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.046112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.046450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.047186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.049373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.075536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1061/2106] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:35 2021] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:36.080167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.093431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f901-ef7e-4cad-9ea0-aafb885c5d3c service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.099699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.100681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.101249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.101674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.102683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.105300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.139872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1046/2107] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:36 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:36.144040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.157557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a651cc7-8bf8-4ceb-805b-37ebc0f12db1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.173896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.174520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.174818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.175280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.175998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.177650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867165fa-f1f2-4761-a977-0afbe6d21931 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.198621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1062/2108] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:36 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:36.203477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.218864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045027-39af-492e-8d8d-10292f8896e9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.227996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.230576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.231141 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.233789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] PATH_INFO: `/v3/projects/5d72bc3e5a234c2db179fbf4fd35374c/users/e9bf08d460684f2192fd0fa7dc2a7d70/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.261639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d72bc3e5a234c2db179fbf4fd35374c, user_id=e9bf08d460684f2192fd0fa7dc2a7d70, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.264781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.292865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1047/2109] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:36 2021] PUT /identity/v3/projects/5d72bc3e5a234c2db179fbf4fd35374c/users/e9bf08d460684f2192fd0fa7dc2a7d70/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:36.294099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.294457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.294803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.356895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] MFA Rules not processed for user `e9bf08d460684f2192fd0fa7dc2a7d70`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:36.358977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:36.502875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1063/2110] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:36 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:36.507460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.618817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5995e9f-32ef-4a72-8572-65613d74db2c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.627132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.628258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.628608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.628888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.629792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.632167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.684721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1048/2111] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:36 2021] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:36.685117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.686628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:36.700500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.714388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ea305-9c84-4110-8463-5c22900cddd2 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.814414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f553-b712-4bcb-af49-dcf98c1aad1c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:36.819022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.821091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.821661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.822116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] PATH_INFO: `/v3/projects/7f8378c85fd5425a87b9a07f6c179024` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.823617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8378c85fd5425a87b9a07f6c179024)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.824308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:36.825224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.826481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.826863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.827523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.829946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:36.838893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032eeb2-0775-45ef-bb1e-3fc0bd926ef7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:36.906624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1049/2112] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:36 2021] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:36.907997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:36.908390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:36.908742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:36.938496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8378c85fd5425a87b9a07f6c179024', 'request_id': 'req-05b0bee3-0009-461d-bd7b-472a022241a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:36.938672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:36.939929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:36.948586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8378c85fd5425a87b9a07f6c179024', 'request_id': 'req-05b0bee3-0009-461d-bd7b-472a022241a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:36.961758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8378c85fd5425a87b9a07f6c179024', 'request_id': 'req-05b0bee3-0009-461d-bd7b-472a022241a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:36.977199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] The token cache is being invalidate because project 7f8378c85fd5425a87b9a07f6c179024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:36.978149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:36.978693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:36.986271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1064/2113] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:36 2021] DELETE /identity/v3/projects/7f8378c85fd5425a87b9a07f6c179024 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:36.988676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:36.993766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.021272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1050/2114] 10.222.0.60 () {58 vars in 967 bytes} [Tue Nov 23 13:01:36 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:37.023082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.025878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.101866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0bee3-0009-461d-bd7b-472a022241a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.108129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.108785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.109077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.109508 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.110134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.111749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.126194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1065/2115] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:36 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:37.127948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.131970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.136456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601379f8-8fdd-462e-a7bb-16b63b64a8c2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.141687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.142490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.142762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.143056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] PATH_INFO: `/v3/users/f924ace5d7c84cd68d8a824b95dcfe99` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.144558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f924ace5d7c84cd68d8a824b95dcfe99)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.146289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.204374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f924ace5d7c84cd68d8a824b95dcfe99'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.214575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f924ace5d7c84cd68d8a824b95dcfe99'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.221797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee02e2-9c7a-4701-a63f-38be3c8f292c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.227681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.228312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.228494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f924ace5d7c84cd68d8a824b95dcfe99'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.228597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.228882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.229159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f924ace5d7c84cd68d8a824b95dcfe99'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.229788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f924ace5d7c84cd68d8a824b95dcfe99'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.231404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.243571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.244461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1051/2116] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:37 2021] DELETE /identity/v3/users/f924ace5d7c84cd68d8a824b95dcfe99 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:37.245304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.246976 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.248566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.258209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1066/2117] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:01:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:37.378074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9019a-bd63-4650-ac21-47c89dc936fc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.384411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.386373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.386823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.387629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] PATH_INFO: `/v3/projects/364668d4150846228a49c168558441da/users/c5c2673ed7234a419c662d91ca8148d9/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.417446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=364668d4150846228a49c168558441da, user_id=c5c2673ed7234a419c662d91ca8148d9, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.421430 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.438698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1052/2118] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:37 2021] PUT /identity/v3/projects/364668d4150846228a49c168558441da/users/c5c2673ed7234a419c662d91ca8148d9/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:37.443459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.456048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18331f-02ec-4cd0-ab1d-43be38138647 service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.556743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.557383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.557673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.558019 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.558710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.560710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225d574-9ce1-4677-96b7-8ef010d53956 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.574963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1067/2119] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:37 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:37.579097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.589519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108c607-8171-4fad-8ae5-b39e4cc64f6b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.594914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.595800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.596091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.596548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] PATH_INFO: `/v3/projects/364668d4150846228a49c168558441da/users/c5c2673ed7234a419c662d91ca8148d9/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.598871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364668d4150846228a49c168558441da, user_id=c5c2673ed7234a419c662d91ca8148d9, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.601622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0dfc-a95e-44d2-8b35-1cbcc428b741 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.609646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.610590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.610874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.614504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1053/2120] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:37 2021] PUT /identity/v3/projects/364668d4150846228a49c168558441da/users/c5c2673ed7234a419c662d91ca8148d9/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:37.625203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.625493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.625773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.640982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:37.642113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.690236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] MFA Rules not processed for user `c5c2673ed7234a419c662d91ca8148d9`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:37.696131 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.742842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1068/2121] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:01:37 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:37.743847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.748808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.823568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1054/2122] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:37 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:37.824542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.826073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.871925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361ffb-e748-4f95-b33a-45c690ff8d35 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.897157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.898094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.900114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.900538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] PATH_INFO: `/v3/projects/3e22441ab1284ff197b48b2f4dd17261` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.904675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e22441ab1284ff197b48b2f4dd17261)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.908001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.914475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6debae-458d-4f49-ab01-3de2f4493c5f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:37.920149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:37.920785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:37.921073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:37.921354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:37.931599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:37.936640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:37.947867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1055/2123] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:01:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:37.949414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:37.951217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:37.986673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e22441ab1284ff197b48b2f4dd17261', 'request_id': 'req-326781cb-c41a-46d9-9a05-c85fb7def1fc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:37.997656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e22441ab1284ff197b48b2f4dd17261', 'request_id': 'req-326781cb-c41a-46d9-9a05-c85fb7def1fc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.014868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e22441ab1284ff197b48b2f4dd17261', 'request_id': 'req-326781cb-c41a-46d9-9a05-c85fb7def1fc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.027615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] The token cache is being invalidate because project 3e22441ab1284ff197b48b2f4dd17261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:38.028093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.029065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-326781cb-c41a-46d9-9a05-c85fb7def1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.030796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1069/2124] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:37 2021] DELETE /identity/v3/projects/3e22441ab1284ff197b48b2f4dd17261 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:38.032665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eb594-54ce-4c41-a947-8cbb774ceaf6 service swift] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.036377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc75c-5d38-41ff-8a25-da1cad2414ee None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.036674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc75c-5d38-41ff-8a25-da1cad2414ee None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.036988 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebc75c-5d38-41ff-8a25-da1cad2414ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.060445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d1ebc75c-5d38-41ff-8a25-da1cad2414ee None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:38.061659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d1ebc75c-5d38-41ff-8a25-da1cad2414ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.110794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.111401 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.111769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.111967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.114322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.180627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1070/2125] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:38.182202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.182492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.182845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.209236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:38.211113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.221166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1071/2126] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:38.225715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.238236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01bcc7-4dcc-4499-8bf2-d63b2c199ad7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.243596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.256456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.257920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.258411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.261023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:38.261268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.264538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.264707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.266478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.278910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1056/2127] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:37 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:38.292983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1072/2128] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:01:38.294523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.307027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ae5a2-637e-4455-8fc7-af6cd8b684e7 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.315975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.316731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.317105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.317473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.318311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.320665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.381066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.382079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1057/2129] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:38.397595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c908-36ae-41db-9179-0c5176a40a6b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.439922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.443081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.499461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.500173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.500514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.500869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.501964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.503998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.536226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1073/2130] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:38.548676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.553127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dad99d-6ff0-4fd0-a808-556eeaf4d012 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.558604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.559474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.560183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.560527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128d60-7278-4fe6-91e8-056c9a07863c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.560641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] PATH_INFO: `/v3/users/e9bf08d460684f2192fd0fa7dc2a7d70` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.561688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bf08d460684f2192fd0fa7dc2a7d70)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.563670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.566281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.567264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.567744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.568197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.569211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.570932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.583517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1074/2131] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:38.587219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.598693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bed8fe-6afb-4733-970e-a959064733d2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.605492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.607427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.607733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.608033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.608788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.610816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.623963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1075/2132] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:38.628456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.639533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a72b-1bc5-4fc9-9621-755443203bc1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.645249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.646553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.647372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.647728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] PATH_INFO: `/v3/projects/82956ea3d15b460884cdd7fce76e94a7/users/e9817bc475cf4e5d89f9dd99649596c5/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.664515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bf08d460684f2192fd0fa7dc2a7d70'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.675347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bf08d460684f2192fd0fa7dc2a7d70'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.679500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82956ea3d15b460884cdd7fce76e94a7, user_id=e9817bc475cf4e5d89f9dd99649596c5, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.682337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b345b-9b52-4769-ae7f-9b020a7f4b08 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.689966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bf08d460684f2192fd0fa7dc2a7d70'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.690951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bf08d460684f2192fd0fa7dc2a7d70'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.691853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-616d5467-b835-4338-8b04-bac6516f0471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bf08d460684f2192fd0fa7dc2a7d70'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:38.707570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1058/2133] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:38 2021] DELETE /identity/v3/users/e9bf08d460684f2192fd0fa7dc2a7d70 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:38.709741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4018f-93f7-4b3a-8f1b-31c90f10a63b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.710575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4018f-93f7-4b3a-8f1b-31c90f10a63b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.711057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4018f-93f7-4b3a-8f1b-31c90f10a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.715558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1076/2134] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:38 2021] PUT /identity/v3/projects/82956ea3d15b460884cdd7fce76e94a7/users/e9817bc475cf4e5d89f9dd99649596c5/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:38.716961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.717256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.717536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.739545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-35c4018f-93f7-4b3a-8f1b-31c90f10a63b None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:38.741150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-35c4018f-93f7-4b3a-8f1b-31c90f10a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.741466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:38.742591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.816624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1059/2135] 10.222.0.60 () {58 vars in 967 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:38.817975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.818284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.818564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.836226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1077/2136] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:38.837431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.839087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.865621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] MFA Rules not processed for user `e9817bc475cf4e5d89f9dd99649596c5`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:38.867611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.938975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf16f8-891b-4000-9609-9e017a8dcf80 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.944511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1060/2137] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:38.944662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.945273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.945574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.945858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.949057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.952407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.955239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.956939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:38.965771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1078/2138] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:01:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:38.966509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:38.968008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:38.982168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df606e-c2f9-45e2-8b4a-f930318db03f service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:38.987664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:38.988333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:38.988624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:38.988908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:38.989560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:38.991619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.028590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726bbc5-19aa-4075-8002-7371a5c9341a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.029480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1079/2139] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:38 2021] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:39.034120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.116172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.116894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.117247 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.117600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.140741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7b02-5678-4317-996e-b4185d983e3b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.153021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.153695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.154313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.154313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.154965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.156944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.184664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1080/2140] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:39 2021] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:39.186264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.197052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37496-a992-43d7-b28f-7daff53a64f9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.203161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.203826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.204134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.204458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.205176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.207197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.224372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1081/2141] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:39.228472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.238366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.239072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ab587-822d-46ed-9de0-d9a11ce822b5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.239817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.243928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.245006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.245359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.245712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] PATH_INFO: `/v3/projects/1c80e0d7093548ef82e18e4b2cef2101/users/4d6dd81a5d0d4799a3dc1ce84fb2f575/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.250803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1061/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:39.284071 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c80e0d7093548ef82e18e4b2cef2101, user_id=4d6dd81a5d0d4799a3dc1ce84fb2f575, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.287069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.309157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1082/2143] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:39 2021] PUT /identity/v3/projects/1c80e0d7093548ef82e18e4b2cef2101/users/4d6dd81a5d0d4799a3dc1ce84fb2f575/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:39.313714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.329402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a73c-f908-4daa-bf1b-15bebdc51c76 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.353080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.355401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:39.458373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.459003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.459311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.459775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.460662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.462727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.475155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1062/2144] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:39.479870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.488190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7132-e815-45cf-89d0-bbf8f37bd475 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.499095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50eca7-438a-47da-a683-d341c551023e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.500038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.501084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.503249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.503686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] PATH_INFO: `/v3/users/d5186793024c4be0974807f53eb5db03` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.506023 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5186793024c4be0974807f53eb5db03)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.508144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.517728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.518555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.518889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.519115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] PATH_INFO: `/v3/projects/1c80e0d7093548ef82e18e4b2cef2101/users/4d6dd81a5d0d4799a3dc1ce84fb2f575/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.521242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c80e0d7093548ef82e18e4b2cef2101, user_id=4d6dd81a5d0d4799a3dc1ce84fb2f575, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:39.526100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee8e1f-f771-4f7c-af4c-c8c7fce12d6d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:39.546679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1063/2145] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:39 2021] PUT /identity/v3/projects/1c80e0d7093548ef82e18e4b2cef2101/users/4d6dd81a5d0d4799a3dc1ce84fb2f575/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:39.560558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.560862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.561147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.602427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5186793024c4be0974807f53eb5db03'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:39.623830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5186793024c4be0974807f53eb5db03'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:39.642179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] MFA Rules not processed for user `4d6dd81a5d0d4799a3dc1ce84fb2f575`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:39.643602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:39.652757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5186793024c4be0974807f53eb5db03'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:39.653832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5186793024c4be0974807f53eb5db03'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:39.654603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-491c28be-2a90-45b9-a30b-2dc86e4cd9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5186793024c4be0974807f53eb5db03'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:39.682585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1083/2146] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:39 2021] DELETE /identity/v3/users/d5186793024c4be0974807f53eb5db03 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:39.687460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.687758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.688198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:39.737968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1064/2147] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:39 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:39.748377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.749956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:39.772438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:39.773772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:39.884751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2c3b-a963-4375-abdf-34c803873dda None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:39.909904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1084/2148] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:39.922770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:39.924083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:39.977027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:39.977801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:39.978095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:39.978374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:40.059124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f498289-6098-4fe1-bdb2-6a465887b4ab None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:40.063202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:40.063810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:40.064109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:40.064435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:40.064626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:40.066640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:40.075156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:40.076682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:40.079351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1065/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:39 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:40.089712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1085/2150] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:40.253618 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:40.255523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:40.276110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f03865-61d2-4e87-889c-057265d98ab7 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:40.286056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:40.288586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:40.289930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:40.290238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] PATH_INFO: `/v3/projects/5d72bc3e5a234c2db179fbf4fd35374c` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:40.293105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d72bc3e5a234c2db179fbf4fd35374c)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:40.297668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:40.408468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d72bc3e5a234c2db179fbf4fd35374c', 'request_id': 'req-d57febf6-d08b-47f5-bea7-34f8f066371b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.419463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d72bc3e5a234c2db179fbf4fd35374c', 'request_id': 'req-d57febf6-d08b-47f5-bea7-34f8f066371b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.433364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d72bc3e5a234c2db179fbf4fd35374c', 'request_id': 'req-d57febf6-d08b-47f5-bea7-34f8f066371b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.449269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] The token cache is being invalidate because project 5d72bc3e5a234c2db179fbf4fd35374c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:40.449605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.450622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.456941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:40.464330 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1066/2151] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:40 2021] DELETE /identity/v3/projects/5d72bc3e5a234c2db179fbf4fd35374c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:40.486086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc54628-30c2-4138-bad1-772a4a814e0c service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:40.567442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:40.568939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:40.569449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:40.569928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] PATH_INFO: `/v3/users/c5c2673ed7234a419c662d91ca8148d9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:40.571309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c2673ed7234a419c662d91ca8148d9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:40.573777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:40.671754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c2673ed7234a419c662d91ca8148d9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.672827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:40.673413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:40.687875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57febf6-d08b-47f5-bea7-34f8f066371b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:40.691752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c2673ed7234a419c662d91ca8148d9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.700654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:40.702658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:40.702942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:40.703223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] PATH_INFO: `/v3/projects/5af3e162dcdd41b88b23a614c94ab2ba` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:40.705390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af3e162dcdd41b88b23a614c94ab2ba)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:40.707324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:40.716317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c2673ed7234a419c662d91ca8148d9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.717079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c2673ed7234a419c662d91ca8148d9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.717699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c2673ed7234a419c662d91ca8148d9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.743359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1086/2152] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:40 2021] DELETE /identity/v3/users/c5c2673ed7234a419c662d91ca8148d9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:40.797195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af3e162dcdd41b88b23a614c94ab2ba', 'request_id': 'req-3f0de79e-d159-491b-9483-122a060e4463'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.809507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af3e162dcdd41b88b23a614c94ab2ba', 'request_id': 'req-3f0de79e-d159-491b-9483-122a060e4463'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.843307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af3e162dcdd41b88b23a614c94ab2ba', 'request_id': 'req-3f0de79e-d159-491b-9483-122a060e4463'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.862555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] The token cache is being invalidate because project 5af3e162dcdd41b88b23a614c94ab2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:40.863142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.864066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:40.866246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1067/2153] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:40 2021] DELETE /identity/v3/projects/5af3e162dcdd41b88b23a614c94ab2ba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:41.454884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:41.456350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.570567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd99bc-2cc3-41e0-ba0c-343def8ceea8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:41.654615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:41.655541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.655913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:41.656868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] PATH_INFO: `/v3/users/e9817bc475cf4e5d89f9dd99649596c5` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:41.658421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9817bc475cf4e5d89f9dd99649596c5)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:41.660725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:41.747218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9817bc475cf4e5d89f9dd99649596c5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.758475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:41.759029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9817bc475cf4e5d89f9dd99649596c5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.759924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.775245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de79e-d159-491b-9483-122a060e4463 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:41.775816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9817bc475cf4e5d89f9dd99649596c5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.777284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9817bc475cf4e5d89f9dd99649596c5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.778682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4dc7ce21-9740-4c24-9dec-02f9e61d0fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9817bc475cf4e5d89f9dd99649596c5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.781350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:41.782236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.782516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:41.782811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] PATH_INFO: `/v3/projects/364668d4150846228a49c168558441da` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:41.783987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364668d4150846228a49c168558441da)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:41.786107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:41.794470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1087/2154] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:41 2021] DELETE /identity/v3/users/e9817bc475cf4e5d89f9dd99649596c5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:41.798664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.799197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:41.799346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:41.825307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:41.826677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.849390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364668d4150846228a49c168558441da', 'request_id': 'req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.865059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364668d4150846228a49c168558441da', 'request_id': 'req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.880486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364668d4150846228a49c168558441da', 'request_id': 'req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.891580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] The token cache is being invalidate because project 364668d4150846228a49c168558441da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:41.891861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.892812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0b9a28ac-8c98-414b-884e-7fb1a9bbc126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:41.894567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1068/2155] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:41 2021] DELETE /identity/v3/projects/364668d4150846228a49c168558441da => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:41.900380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834de7-74ff-4a28-bd19-c9bb4808c861 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.900726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834de7-74ff-4a28-bd19-c9bb4808c861 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:41.901012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834de7-74ff-4a28-bd19-c9bb4808c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:41.908728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1088/2156] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:41.919833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:41.921577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.927787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9d834de7-74ff-4a28-bd19-c9bb4808c861 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:41.929340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9d834de7-74ff-4a28-bd19-c9bb4808c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.943251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1069/2157] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:41.945350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.945650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:41.945946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:41.970315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:41.971745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:41.983080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1070/2158] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:41.984220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:41.994198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a381c-aed5-4992-b3be-0618c74b6b3e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:41.998940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:41.999443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:41.999724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.000051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.000791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:42.000901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc132b-2ac0-4d37-8e36-e087f91cf293 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.001089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.003148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.007386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.008083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.008411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.008719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.017335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1071/2159] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:01:42.020308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.021411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.021885 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.032140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27373f3-7918-4016-96bb-bfc49276e163 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.037113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1089/2160] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:42.037541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.038351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.038633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.038908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.039574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.041678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.079097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1072/2161] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:42 2021] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:42.083156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.093209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ec029-fa4f-44c3-80dc-32bdae0649e3 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.159201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.159886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.160185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.160510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.161176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.163101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.185295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1090/2162] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:42 2021] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:42.189514 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.199769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fcce9-0705-4008-871c-b438a62320a0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.204581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.205298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.205619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.205892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.206637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.208315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.219158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1073/2163] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:42.223804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.234737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc01cc-ad0f-4417-8958-e96bc1450657 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.239560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.240567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.240950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.241308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.242078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.244580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.259227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1091/2164] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:42 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:42.263331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.273316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987b34-0102-4583-8ff0-c2b3e5895a5f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.277638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.278529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.278899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.279178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] PATH_INFO: `/v3/projects/20f4927448774fa9b0e4268c876121fd/users/8a79bb578b6b4f5992037d5920a7b91f/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.407521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f4927448774fa9b0e4268c876121fd, user_id=8a79bb578b6b4f5992037d5920a7b91f, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.410395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab2f3-4c22-41b4-a102-b4fde9286c0b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.427089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1074/2165] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:42 2021] PUT /identity/v3/projects/20f4927448774fa9b0e4268c876121fd/users/8a79bb578b6b4f5992037d5920a7b91f/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:42.438197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.440337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.440472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.440682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.440967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.455681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aed557-31f9-48f1-8e5d-bdfef93faf82 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.486617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] MFA Rules not processed for user `8a79bb578b6b4f5992037d5920a7b91f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:42.487869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.542413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.544270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.544573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.544861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] PATH_INFO: `/v3/projects/82956ea3d15b460884cdd7fce76e94a7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.546489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82956ea3d15b460884cdd7fce76e94a7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.549333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.576496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1075/2166] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:42 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:42.576496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.576496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.589050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061b1b2-0e51-47d2-ba56-b84acf18cb6c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.593749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.594559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.594843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.595126 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] PATH_INFO: `/v3/users/6bb98e201f2f41b18735465a450909ad` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.596335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb98e201f2f41b18735465a450909ad)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.598343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.605285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82956ea3d15b460884cdd7fce76e94a7', 'request_id': 'req-5c9f0a34-f3ca-4485-9a6e-697a58793c91'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.614679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82956ea3d15b460884cdd7fce76e94a7', 'request_id': 'req-5c9f0a34-f3ca-4485-9a6e-697a58793c91'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.628931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82956ea3d15b460884cdd7fce76e94a7', 'request_id': 'req-5c9f0a34-f3ca-4485-9a6e-697a58793c91'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.641106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] The token cache is being invalidate because project 82956ea3d15b460884cdd7fce76e94a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:42.641641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.642572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.644310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1092/2167] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:42 2021] DELETE /identity/v3/projects/82956ea3d15b460884cdd7fce76e94a7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:42.645070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.646344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.654454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb98e201f2f41b18735465a450909ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.662833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb98e201f2f41b18735465a450909ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.675563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb98e201f2f41b18735465a450909ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.676519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb98e201f2f41b18735465a450909ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.677292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb98e201f2f41b18735465a450909ad'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.691712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1076/2168] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:42 2021] DELETE /identity/v3/users/6bb98e201f2f41b18735465a450909ad => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:42.692881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:42.695829 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.761368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0a34-f3ca-4485-9a6e-697a58793c91 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.826786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4718b6-d5f6-4281-8fa0-eadb3e881ac5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:42.831475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.832080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.832395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.832671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.833545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.834442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:42.835434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb5f93-30d9-4c4f-9f48-dc04788809b2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.835703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.836201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.837147 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] PATH_INFO: `/v3/users/4d6dd81a5d0d4799a3dc1ce84fb2f575` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.838703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6dd81a5d0d4799a3dc1ce84fb2f575)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:42.840961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:42.895067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1093/2169] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:42 2021] POST /identity/v3/projects => generated 409 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:42.896484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:42.896772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:42.898801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:42.926167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6dd81a5d0d4799a3dc1ce84fb2f575'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.941852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6dd81a5d0d4799a3dc1ce84fb2f575'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.948891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:42.954700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:42.967307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6dd81a5d0d4799a3dc1ce84fb2f575'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.970165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6dd81a5d0d4799a3dc1ce84fb2f575'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:42.971216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6dd81a5d0d4799a3dc1ce84fb2f575'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.001098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1077/2170] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:42 2021] DELETE /identity/v3/users/4d6dd81a5d0d4799a3dc1ce84fb2f575 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:43.003116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.004938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:43.110073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b47cb-f5d9-4f0a-a934-c59e81e8f1dc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.117193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.118128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.118641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.119119 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.120381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.123404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.128358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1094/2171] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:43.153411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.154966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:43.162250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1078/2172] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:43 2021] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:43.166362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.188512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad080-be0e-4ed1-b52f-f6fada9d2020 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.208919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.209533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.209818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.210101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.210811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.212454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.234955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1079/2173] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:43.237379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.251230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fc93f-2e65-45f6-9747-243bd50a017c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.269977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.270808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.271033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.271307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] PATH_INFO: `/v3/projects/6e494fbdbf584dd7a824752c370a06e2/users/2f47530e627e472fa4abbef372416728/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.305264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534a6f-7114-41a0-b93a-3028a455e44a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.313873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e494fbdbf584dd7a824752c370a06e2, user_id=2f47530e627e472fa4abbef372416728, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.326111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.357692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1080/2174] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:43 2021] PUT /identity/v3/projects/6e494fbdbf584dd7a824752c370a06e2/users/2f47530e627e472fa4abbef372416728/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:43.358826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.368919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.369624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.370004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.370357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.381149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.382688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.393561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1095/2175] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:43.459974 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7624a-0930-4134-83d2-f7d1d3032b3a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.466146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.466922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.468394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.468729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.469497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.471610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf5120-2ea9-4830-9d27-2ca10db28ead admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.495455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1081/2176] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:43.499875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.510423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f58551-21ad-4d78-a284-2dbaab948cc5 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.515474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.516377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.516797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.517085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] PATH_INFO: `/v3/projects/6e494fbdbf584dd7a824752c370a06e2/users/2f47530e627e472fa4abbef372416728/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.534740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e494fbdbf584dd7a824752c370a06e2, user_id=2f47530e627e472fa4abbef372416728, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.537510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.582748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1096/2177] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:43 2021] PUT /identity/v3/projects/6e494fbdbf584dd7a824752c370a06e2/users/2f47530e627e472fa4abbef372416728/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:43.583465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.583830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.584111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.671595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] MFA Rules not processed for user `2f47530e627e472fa4abbef372416728`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:43.672828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:43.711318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.713994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:43.796534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1082/2178] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:43 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:43.807159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:43.807575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:43.827772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7276c0-b426-4048-a898-419cf8185385 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.834280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.835378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.835709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.835995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] PATH_INFO: `/v3/projects/1c80e0d7093548ef82e18e4b2cef2101` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.837389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c80e0d7093548ef82e18e4b2cef2101)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.839761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.887493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a464c5-1f47-4629-84be-cfeaca7b8d66 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:43.897799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:43.898431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.898685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.898975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:43.917283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:43.921008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96dda0-824a-4370-a241-7d4c030f02d1 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:43.937761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c80e0d7093548ef82e18e4b2cef2101', 'request_id': 'req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.952284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1083/2179] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:43 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:43.953807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c80e0d7093548ef82e18e4b2cef2101', 'request_id': 'req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.967593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c80e0d7093548ef82e18e4b2cef2101', 'request_id': 'req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.980298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] The token cache is being invalidate because project 1c80e0d7093548ef82e18e4b2cef2101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:43.980298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.981464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-faeda29a-8485-49b2-b4a7-5a341e5ca4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:43.984177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1097/2180] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:43 2021] DELETE /identity/v3/projects/1c80e0d7093548ef82e18e4b2cef2101 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:43.989924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:43.990221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:43.990513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.020025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:44.021249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.116450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1084/2181] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:44.127420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.127944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.128494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.161115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.163353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.166765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:44.168014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.181188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1098/2182] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:44.182450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.196034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c98771-065a-433d-9e1e-c8753d607fd3 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.205826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.206578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.206863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.207288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.208157 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:44.208495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.210243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.227781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1099/2183] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:44.233274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.244924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a9967-6f9b-4ddc-a289-d0be1a773e33 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.250359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.252225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.252647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.253003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.256267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.256429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0f877-856f-4a33-97f9-8696b60ffb47 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.256528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.261067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.261650 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.261934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.262530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.264463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.328219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1100/2184] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:44.329278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.331295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.358039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.360123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.369936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1085/2185] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:44 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:44.370631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.381568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f10518-b06c-4343-93c2-d63eedd54c0b service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.422435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799795be-5dc3-41d0-91c9-ca7ee5eeb271 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.427558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.428416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.428701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.428977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] PATH_INFO: `/v3/projects/727d331da092466b8d717a7e039a5b7b` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.430338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] RBAC: Authorizing `identity:delete_project(project_id=727d331da092466b8d717a7e039a5b7b)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.433656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.460787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.461843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.462552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.463124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.464467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.467748 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.504294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727d331da092466b8d717a7e039a5b7b', 'request_id': 'req-1af6cd8b-21c7-4172-b7ab-b670da81292b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:44.512374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1086/2186] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:44.513743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727d331da092466b8d717a7e039a5b7b', 'request_id': 'req-1af6cd8b-21c7-4172-b7ab-b670da81292b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:44.514176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.524820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e27d2-2fa0-4d69-808b-d915da86a4e7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.526453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727d331da092466b8d717a7e039a5b7b', 'request_id': 'req-1af6cd8b-21c7-4172-b7ab-b670da81292b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:44.537958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] The token cache is being invalidate because project 727d331da092466b8d717a7e039a5b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:44.538378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:44.539215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1af6cd8b-21c7-4172-b7ab-b670da81292b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:44.540955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1101/2187] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:44 2021] DELETE /identity/v3/projects/727d331da092466b8d717a7e039a5b7b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:44.547586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee94-3de3-4503-b0e1-8cb8828fde51 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.547878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee94-3de3-4503-b0e1-8cb8828fde51 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.548585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee94-3de3-4503-b0e1-8cb8828fde51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.571965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-fe0bee94-3de3-4503-b0e1-8cb8828fde51 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:44.573147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fe0bee94-3de3-4503-b0e1-8cb8828fde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.601235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.601760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.602603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.602603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.603008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.604667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.617700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1087/2188] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:44.622775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.624489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.637921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6640ea6-87a9-4397-8a28-d5170f136ee1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.643487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.644091 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.644477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.644784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.645558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1102/2189] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:44.651784 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.653129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.653424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.653780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.653906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.667947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1088/2190] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:44.668992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.678304 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:44.678674 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26536-c021-4a35-88cb-6792ca73790c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.679481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.683272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.684189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.684597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.685033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] PATH_INFO: `/v3/projects/1484a27e1736443daae443a57a145adf/users/52edff9a2e33404e83e1e0b485b9546f/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.688161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1103/2191] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:44.692878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.702333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150e4c-7ef2-47c7-9f4c-05dbe7baacea None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.708205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.708853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.709135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.709411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.710120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:44.710415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.712172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.713793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1484a27e1736443daae443a57a145adf, user_id=52edff9a2e33404e83e1e0b485b9546f, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.716772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bfed1-c5be-48ea-b69d-a58168b05951 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.728105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1104/2192] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:01:44.733278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.745993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97931d-ee75-4724-8404-aaf49e8ca2d8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:44.752967 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1089/2193] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:44 2021] PUT /identity/v3/projects/1484a27e1736443daae443a57a145adf/users/52edff9a2e33404e83e1e0b485b9546f/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:44.764326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.764633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.764918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.810812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] MFA Rules not processed for user `52edff9a2e33404e83e1e0b485b9546f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:44.812188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:44.928273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:44.928854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:44.929145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:44.929504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:44.930178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:44.932302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:44.978073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1105/2194] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:44.979883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:44.998007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1090/2195] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:45.002861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.026338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ba4a-3d45-41f6-b004-75a8a532ad77 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.086090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca428-6fda-40ba-8543-bc68969bbdb1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.093528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.094570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.095160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.095587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.096935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.100201 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.134016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1106/2196] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:44 2021] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:45.138980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.151299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157114-bf2a-4257-9266-b7cea8f3486a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.156307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.157006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.157509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.157656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.157893 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.158176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.158613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.158843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.159287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.160470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.160785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.162502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.179167 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1107/2197] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:45.180705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.192570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945a274-e620-4627-833f-417d0cc643bd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.197978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.198969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.199635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.200535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.202006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.204436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.225750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1091/2198] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:45 2021] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:45.225750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.226958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1108/2199] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:45.229034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.243085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fd58-bb4f-44d0-87d3-683a9bcf7a63 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.337107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81a90-29a0-412f-ac23-d52b45fb5315 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.342579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.343211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.343499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.343796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.344493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.346422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.351678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.352561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.352854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.353592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] PATH_INFO: `/v3/projects/a76cd93551c243ffac2329a86c7fce12/users/e1f010313d3e4875994e8537e8c9c558/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.377656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1092/2200] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:45 2021] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:45.382029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.392088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76cd93551c243ffac2329a86c7fce12, user_id=e1f010313d3e4875994e8537e8c9c558, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.394622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e177b-2db3-4bcd-bb8f-580760dd2c35 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.395161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf313c9-053b-4821-a3d0-23709263f039 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.400456 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.401587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.402586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.402586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.403777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.405777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.419063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1109/2201] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:45 2021] PUT /identity/v3/projects/a76cd93551c243ffac2329a86c7fce12/users/e1f010313d3e4875994e8537e8c9c558/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:45.421056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1093/2202] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:01:45.425135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.425408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.425756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.429348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.439634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d0e7-645a-4bfe-9df8-0f189f72d83a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.456069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:45.457744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:45.536526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.537394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.537689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.537975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] PATH_INFO: `/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177/users/3cbff3889bf743d281e8781197c6d4f3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.563217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b7d4c0b35d4ea2ba12f669dc5a9177, user_id=3cbff3889bf743d281e8781197c6d4f3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.567903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.591951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1094/2203] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:45 2021] PUT /identity/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177/users/3cbff3889bf743d281e8781197c6d4f3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:45.595273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.660534 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1110/2204] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:45.676870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.678291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:45.718498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759f9f5-912c-40cb-a5db-55b4f90370e0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.724171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.725288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.725690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.726040 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.727260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.728693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.740809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1095/2205] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:45.745030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:45.777596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb902-f3f8-4f9b-9bf7-47d35e99a277 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.783341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.784345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.784855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.785234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] PATH_INFO: `/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177/users/3cbff3889bf743d281e8781197c6d4f3/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.787467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b7d4c0b35d4ea2ba12f669dc5a9177, user_id=3cbff3889bf743d281e8781197c6d4f3, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.790371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede8b0c-81a6-4065-a456-eda50020e9b5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.804062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3c8ce-bed3-485c-95e0-3eb5deb4659a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:45.808587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1096/2206] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:45 2021] PUT /identity/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177/users/3cbff3889bf743d281e8781197c6d4f3/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:45.812498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.812795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.813077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.869339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] MFA Rules not processed for user `3cbff3889bf743d281e8781197c6d4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:45.872453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:45.889817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:45.890868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:45.891330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:45.891964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:45.988971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:45.990426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:45.996891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1097/2207] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:45 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:46.002097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:46.003035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1111/2208] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:46.004587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:46.090941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d8168-bbae-435a-b5c1-9d9186399c3e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:46.095825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:46.096931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:46.096931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:46.097417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:46.108292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:46.109850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f2e-d41c-4d0e-be06-2ef619c46449 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:46.121757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1098/2209] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:46 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:01:46.783952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:46.794451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f874bc-9a18-4f25-afb4-10ea9c7e2fce service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:46.810052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:46.811644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:46.812119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:46.812769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] PATH_INFO: `/v3/users/52edff9a2e33404e83e1e0b485b9546f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:46.814119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52edff9a2e33404e83e1e0b485b9546f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:46.819444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:46.889827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52edff9a2e33404e83e1e0b485b9546f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:46.914274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52edff9a2e33404e83e1e0b485b9546f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:46.958137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52edff9a2e33404e83e1e0b485b9546f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:46.958948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52edff9a2e33404e83e1e0b485b9546f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:46.960333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52edff9a2e33404e83e1e0b485b9546f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:46.998175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1112/2210] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:46 2021] DELETE /identity/v3/users/52edff9a2e33404e83e1e0b485b9546f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:46.999787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:47.000082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:47.000405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:47.028873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:47.030062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:47.155759 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1099/2211] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:47.242973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:47.244440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:47.320973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7079-eaf9-4ac9-800d-b6666881ba1c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:47.324874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:47.325576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:47.325810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:47.326244 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:47.336557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:47.338559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:47.349760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1113/2212] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:48.068068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:48.069553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:48.081906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fab82-479c-4c00-96ad-fbb2287e9ccf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:48.099136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:48.100009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:48.100400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:48.100744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] PATH_INFO: `/v3/projects/1484a27e1736443daae443a57a145adf` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:48.101927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1484a27e1736443daae443a57a145adf)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:48.103958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:48.160757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1484a27e1736443daae443a57a145adf', 'request_id': 'req-e97c2c81-6db1-4584-b651-3e53ed2ee85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.169459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1484a27e1736443daae443a57a145adf', 'request_id': 'req-e97c2c81-6db1-4584-b651-3e53ed2ee85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.181983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1484a27e1736443daae443a57a145adf', 'request_id': 'req-e97c2c81-6db1-4584-b651-3e53ed2ee85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.193751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] The token cache is being invalidate because project 1484a27e1736443daae443a57a145adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:48.194036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.194679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.199317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1100/2213] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:48 2021] DELETE /identity/v3/projects/1484a27e1736443daae443a57a145adf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:48.200452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:48.210141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1de82f-2c0a-428b-ab4d-8e7188eca752 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:48.327532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:48.329159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:48.332924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:48.332924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] PATH_INFO: `/v3/users/3cbff3889bf743d281e8781197c6d4f3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:48.332924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbff3889bf743d281e8781197c6d4f3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:48.335413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:48.406920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbff3889bf743d281e8781197c6d4f3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.417350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbff3889bf743d281e8781197c6d4f3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.434849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbff3889bf743d281e8781197c6d4f3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.435644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbff3889bf743d281e8781197c6d4f3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.436412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-68675f81-a79a-45fe-b2d0-eb7605fc2680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbff3889bf743d281e8781197c6d4f3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:48.452414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1114/2214] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:48 2021] DELETE /identity/v3/users/3cbff3889bf743d281e8781197c6d4f3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:01:49.620414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:49.622477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:49.635869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2c81-6db1-4584-b651-3e53ed2ee85d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:49.730022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:49.730858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:49.731370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:49.731619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] PATH_INFO: `/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:49.733086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b7d4c0b35d4ea2ba12f669dc5a9177)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:49.735030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:49.797574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b7d4c0b35d4ea2ba12f669dc5a9177', 'request_id': 'req-90b16eee-04dd-4c3a-8587-24176e0551c3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:49.806314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b7d4c0b35d4ea2ba12f669dc5a9177', 'request_id': 'req-90b16eee-04dd-4c3a-8587-24176e0551c3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:49.819769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b7d4c0b35d4ea2ba12f669dc5a9177', 'request_id': 'req-90b16eee-04dd-4c3a-8587-24176e0551c3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:49.829874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] The token cache is being invalidate because project 32b7d4c0b35d4ea2ba12f669dc5a9177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:49.830140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:49.830794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-90b16eee-04dd-4c3a-8587-24176e0551c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:49.832565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1101/2215] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:49 2021] DELETE /identity/v3/projects/32b7d4c0b35d4ea2ba12f669dc5a9177 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:49.839659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:49.840408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:49.840733 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:49.864291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:49.865471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:49.932568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1115/2216] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:49.940764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:49.941011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:49.941299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:49.966133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:49.967295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:49.980085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1102/2217] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:49.984547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:49.993950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6fbb1-bbf6-4415-823c-e5dfd79c6aaf None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:49.998996 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:49.999476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:49.999771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.000050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.000910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:01:50.001394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.003051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.016935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1116/2218] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:01:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:01:50.021559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.031995 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afa18b-e867-4abc-b89e-7dc76c064ebf None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.036541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.037136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.037575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.037864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.038515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.040426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.072775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1103/2219] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:50 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:50.076854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.089768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb274-f88f-42d4-9762-13976f3ef7de admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.205373 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.207172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.207745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.208264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.209468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.214030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.257125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1117/2220] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:50 2021] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:50.262849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.276938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d409c72-4cf0-44d0-a083-ab21bb987216 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.298267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.299223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.299731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.300271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.301577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.304662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.324855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1104/2221] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:50.331626 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.346479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d30766-6f13-4ad6-b872-136c7a6f2cc1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.358557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.359616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.360117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.360587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.361594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.364177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a52c40-3e2b-4034-af8e-a3bf876f831d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.378566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1118/2222] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:50.383551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.398448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487b797-9aa8-4161-b930-973f1a1ef4a4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.406208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.407042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.408127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.408440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] PATH_INFO: `/v3/projects/783a3b0c91fb4deb86f3df61ea30d708/users/8a570869a4df47fd93c908ccbcd0123c/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.437633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783a3b0c91fb4deb86f3df61ea30d708, user_id=8a570869a4df47fd93c908ccbcd0123c, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.440871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.467548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1105/2223] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:50 2021] PUT /identity/v3/projects/783a3b0c91fb4deb86f3df61ea30d708/users/8a570869a4df47fd93c908ccbcd0123c/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:50.468984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc878-e780-4882-85f7-b56811d04ebd None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.469282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc878-e780-4882-85f7-b56811d04ebd None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.469571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc878-e780-4882-85f7-b56811d04ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.516132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-913cc878-e780-4882-85f7-b56811d04ebd None None] MFA Rules not processed for user `8a570869a4df47fd93c908ccbcd0123c`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:50.517966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-913cc878-e780-4882-85f7-b56811d04ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:50.628750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1119/2224] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:50 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:01:50.641505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:50.643929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:50.712265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54acb-d9fc-4901-a3f5-71692c6b6736 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:50.716357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:50.717047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:50.717402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:50.717740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:50.727310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:50.729283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:50.739880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1106/2225] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:50 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:54.142190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.142839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.142839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.186720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] MFA Rules not processed for user `e1f010313d3e4875994e8537e8c9c558`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:54.188194 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:54.279966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1120/2226] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:54 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:54.285335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.291543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:54.393937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d23cce-c15e-409d-b338-c33b8683867f service glance] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.398115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.398705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.398993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.399275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.399935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.402003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.439790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1107/2227] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:01:54 2021] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:01:54.441154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.452227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912d0f-7e7b-47c7-a1c0-3fc6906a51f0 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.523670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.524297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.524600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.524877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.525540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.527613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.550625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1121/2228] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:01:54 2021] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:01:54.555507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.570340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e958b5b-9fc0-4a70-9462-81f25421d5a9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.577707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.578321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.579221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.579221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.579574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.581218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.592867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1108/2229] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:54.597234 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.610466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44bacd-5b88-4881-8d65-7ac3c0b96a6f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.615062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.615900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.616185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.616610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] PATH_INFO: `/v3/projects/f9d41868988941708c26c7869f8c3a9a/users/8073ab8f15c64c2e8adc6ce2cdc5d13c/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.638710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d41868988941708c26c7869f8c3a9a, user_id=8073ab8f15c64c2e8adc6ce2cdc5d13c, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.641466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.656647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1122/2230] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:54 2021] PUT /identity/v3/projects/f9d41868988941708c26c7869f8c3a9a/users/8073ab8f15c64c2e8adc6ce2cdc5d13c/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:54.660883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.672607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d860f-6802-415f-a52d-85a162d8ee4b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.749254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.749865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.750150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.750429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.751526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.753177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.768431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1109/2231] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:01:54.771704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:54.826545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09eb1-c8f3-460e-b159-a52ba28c79f0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:54.852076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:54.854288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:54.854821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:54.856796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] PATH_INFO: `/v3/projects/f9d41868988941708c26c7869f8c3a9a/users/8073ab8f15c64c2e8adc6ce2cdc5d13c/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:54.862785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d41868988941708c26c7869f8c3a9a, user_id=8073ab8f15c64c2e8adc6ce2cdc5d13c, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:54.877693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ca705-247e-4514-8aa3-dde9ae499e96 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:54.917378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1123/2232] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:01:54 2021] PUT /identity/v3/projects/f9d41868988941708c26c7869f8c3a9a/users/8073ab8f15c64c2e8adc6ce2cdc5d13c/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:55.484895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:55.487223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:55.506239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033dbec-41df-4c80-a4c8-0f14f7873935 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:55.658011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:55.659075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:55.659554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:55.659997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] PATH_INFO: `/v3/users/8a79bb578b6b4f5992037d5920a7b91f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:55.670008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a79bb578b6b4f5992037d5920a7b91f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:55.673360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:55.799503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a79bb578b6b4f5992037d5920a7b91f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:55.826265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a79bb578b6b4f5992037d5920a7b91f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:55.883531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a79bb578b6b4f5992037d5920a7b91f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:55.884923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a79bb578b6b4f5992037d5920a7b91f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:55.886277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a79bb578b6b4f5992037d5920a7b91f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:55.924521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1110/2233] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:55 2021] DELETE /identity/v3/users/8a79bb578b6b4f5992037d5920a7b91f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:55.930066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:55.931240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:55.931762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:56.005497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:56.006701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:56.187272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1124/2234] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:56.259312 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:56.261325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:56.370918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c2b5b-c83f-4ba2-9419-91d174526988 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:56.380614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:56.381251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:56.381548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:56.381843 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:56.397985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:56.399702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:56.421022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1111/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:01:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:01:57.767235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:57.769877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:57.790236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97401d4f-0cb3-4f88-9d6c-c681741e3157 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:57.796537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:57.797709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:57.798182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:57.798640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] PATH_INFO: `/v3/projects/20f4927448774fa9b0e4268c876121fd` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:57.800291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f4927448774fa9b0e4268c876121fd)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:57.803102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:57.905450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f4927448774fa9b0e4268c876121fd', 'request_id': 'req-e2e572a5-79cd-4705-a380-53373800f10a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:57.918784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f4927448774fa9b0e4268c876121fd', 'request_id': 'req-e2e572a5-79cd-4705-a380-53373800f10a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:57.934506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f4927448774fa9b0e4268c876121fd', 'request_id': 'req-e2e572a5-79cd-4705-a380-53373800f10a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:57.959560 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] The token cache is being invalidate because project 20f4927448774fa9b0e4268c876121fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:01:57.959920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:57.960613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e2e572a5-79cd-4705-a380-53373800f10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:57.965367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1125/2236] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:57 2021] DELETE /identity/v3/projects/20f4927448774fa9b0e4268c876121fd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:57.966779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:57.979196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c38c-af63-4b70-a61a-30a545a477a3 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:58.097252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:58.098208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:58.098617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:58.098988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] PATH_INFO: `/v3/users/2f47530e627e472fa4abbef372416728` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:58.101308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f47530e627e472fa4abbef372416728)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:58.104128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:58.209163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f47530e627e472fa4abbef372416728'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:58.232180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f47530e627e472fa4abbef372416728'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:58.271700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f47530e627e472fa4abbef372416728'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:58.275364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f47530e627e472fa4abbef372416728'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:58.276599 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f47530e627e472fa4abbef372416728'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:58.324188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1112/2237] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:01:57 2021] DELETE /identity/v3/users/2f47530e627e472fa4abbef372416728 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:01:58.378738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e7b5-c2c4-4dd3-aeac-2c77baa0ad07 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:58.379430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e7b5-c2c4-4dd3-aeac-2c77baa0ad07 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:58.380091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e7b5-c2c4-4dd3-aeac-2c77baa0ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:58.417323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-eae8e7b5-c2c4-4dd3-aeac-2c77baa0ad07 None None] MFA Rules not processed for user `ec0fe7fa96d645ecbc1e50fb5595971d`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:01:58.419314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-eae8e7b5-c2c4-4dd3-aeac-2c77baa0ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:58.545447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1126/2238] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:01:58 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:01:59.624548 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:01:59.626905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:01:59.751584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66571e-6658-4989-9b8a-ec2b1151335e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:01:59.761536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:01:59.762686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:01:59.763165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:01:59.763594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] PATH_INFO: `/v3/projects/6e494fbdbf584dd7a824752c370a06e2` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:01:59.765283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e494fbdbf584dd7a824752c370a06e2)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:01:59.768463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:01:59.850367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e494fbdbf584dd7a824752c370a06e2', 'request_id': 'req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:59.867466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e494fbdbf584dd7a824752c370a06e2', 'request_id': 'req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:59.906630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e494fbdbf584dd7a824752c370a06e2', 'request_id': 'req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:01:59.997356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] The token cache is being invalidate because project 6e494fbdbf584dd7a824752c370a06e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:02:00.003741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:00.005163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7b1e393c-e3c3-4e3d-8b51-06163f124c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:00.014203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1113/2239] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:01:59 2021] DELETE /identity/v3/projects/6e494fbdbf584dd7a824752c370a06e2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:00.019668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.020162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.020431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.061473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:00.066315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:00.322302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1127/2240] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:00.329962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.330288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.330525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.360691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:00.361915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:00.394018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1114/2241] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:00.398153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.409652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6d698-2a67-408a-92f0-73616bc8c817 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:00.415678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:00.417580 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.418218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.418489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.419233 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:02:00.419538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:00.423202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:00.456082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1128/2242] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:02:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:02:00.457148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.471660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cbae9-7c72-4369-9cdd-62725b299a86 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:00.488524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:00.489538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.489854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.490199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.491157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:00.497577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:00.546345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1115/2243] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:02:00 2021] POST /identity/v3/projects => generated 361 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:00.548171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.565738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521aba9-d6e3-425f-bba2-167a93352ca0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:00.753921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:00.756642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.757122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.757562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.758380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:00.762116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:00.795867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1129/2244] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:02:00 2021] POST /identity/v3/users => generated 281 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:00.800069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.823580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95111-e340-4b0a-b77c-80fd9cec6229 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:00.836302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:00.837236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.837778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.838242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.839221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:00.845274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:00.889463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1116/2245] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:00.893531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.921915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94af3-6ed9-46db-ad06-4d01fd382069 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:00.933225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:00.934678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:00.934968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:00.935248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:00.935960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:00.941225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778387d-99d4-4b37-9a03-8dde86231337 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:00.969237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:00.969634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1130/2246] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:00.995667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf670d51-0137-46ff-b425-cda3beeeaf73 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:01.001406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:01.002662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:01.003238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:01.012325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] PATH_INFO: `/v3/projects/085bafc504304c4b9a0ab229491d2f64/users/65f8b39a99a64f8facb63f24eea89f5a/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:01.057652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085bafc504304c4b9a0ab229491d2f64, user_id=65f8b39a99a64f8facb63f24eea89f5a, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:01.065075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dafc4-c4e6-4797-850c-83322da4f674 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:01.095984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1117/2247] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:02:00 2021] PUT /identity/v3/projects/085bafc504304c4b9a0ab229491d2f64/users/65f8b39a99a64f8facb63f24eea89f5a/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:02:01.108109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec24f-0dc8-46cf-b434-ec062cc9527a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:01.108698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec24f-0dc8-46cf-b434-ec062cc9527a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:01.108698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec24f-0dc8-46cf-b434-ec062cc9527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:01.163514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-990ec24f-0dc8-46cf-b434-ec062cc9527a None None] MFA Rules not processed for user `65f8b39a99a64f8facb63f24eea89f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:01.164947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-990ec24f-0dc8-46cf-b434-ec062cc9527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:01.290903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1131/2248] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:01 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:01.321269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447667d-1f8e-4cf8-98af-876df975c7d2 None None] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:01.321755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447667d-1f8e-4cf8-98af-876df975c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:01.322343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447667d-1f8e-4cf8-98af-876df975c7d2 None None] PATH_INFO: `/` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:01.326029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1118/2249] 10.222.0.60 () {54 vars in 962 bytes} [Tue Nov 23 13:02:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 13:02:01.331359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:01.331656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:01.331941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:01.394124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] MFA Rules not processed for user `4f54266b73f542309722b317e80e5f95`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:01.395677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:01.542677 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1132/2250] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Nov 23 13:02:01 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:02:01.553339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447667d-1f8e-4cf8-98af-876df975c7d2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:01.578413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447667d-1f8e-4cf8-98af-876df975c7d2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:01.588657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:01.589271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:01.589559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:01.589871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:01.606635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:01.609874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac5393-abc4-49f4-bdad-90681cf08370 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:01.646263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1119/2251] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:01 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:01.940455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:02.157134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b96e76-a333-423a-9512-0b467f2cc9e8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:02.171007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:02.172184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:02.172517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:02.173459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] PATH_INFO: `/v3/users/65f8b39a99a64f8facb63f24eea89f5a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:02.173949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f8b39a99a64f8facb63f24eea89f5a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:02.175928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:02.280087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f8b39a99a64f8facb63f24eea89f5a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:02.292636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f8b39a99a64f8facb63f24eea89f5a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:02.322719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f8b39a99a64f8facb63f24eea89f5a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:02.326189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f8b39a99a64f8facb63f24eea89f5a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:02.327256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f8b39a99a64f8facb63f24eea89f5a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:02.361853 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1133/2252] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:02:01 2021] DELETE /identity/v3/users/65f8b39a99a64f8facb63f24eea89f5a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:02.367400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:02.368047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:02.368047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:02.415667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:02.417156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:02.554992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1120/2253] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:02:02.641768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:02.644101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:02.776731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5328be5-14c3-4492-927d-bc2aaf069cd2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:02.783974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:02.784827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:02.785387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:02.786389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:02.809823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:02.812698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a545eea-f65c-48ce-8040-db2cc2b7acb6 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:02.833417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1134/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:03.872532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:03.879694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:03.901603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc968ec-6144-4f07-a060-6feaeb34e71f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:03.908300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:03.909672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:03.910130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:03.910564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] PATH_INFO: `/v3/projects/085bafc504304c4b9a0ab229491d2f64` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:03.913096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=085bafc504304c4b9a0ab229491d2f64)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:03.915588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:04.036769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085bafc504304c4b9a0ab229491d2f64', 'request_id': 'req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:04.058944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085bafc504304c4b9a0ab229491d2f64', 'request_id': 'req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:04.121915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085bafc504304c4b9a0ab229491d2f64', 'request_id': 'req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:04.153871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] The token cache is being invalidate because project 085bafc504304c4b9a0ab229491d2f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:02:04.154425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:04.156794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-afe4fb2a-2acf-4fe5-9a92-9bd8f64cf9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:04.165082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1121/2255] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:02:03 2021] DELETE /identity/v3/projects/085bafc504304c4b9a0ab229491d2f64 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:04.172364 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.173598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.174083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.236150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:04.240991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:04.425319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1135/2256] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:04.433481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.434237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.434629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.493118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:04.494174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:04.518201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1122/2257] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:04.521554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:04.532295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65418a-4cb2-4a3b-b480-3ccf5fd84643 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:04.537676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:04.538724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.539232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.539675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.540609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:02:04.541309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:04.543746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:04.578675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1136/2258] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:02:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:02:04.579630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:04.593898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d0490-6058-4666-997b-4b541fecbdf8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:04.610863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:04.615187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.615482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.615755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.616450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:04.624678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:04.718428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:04.720640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1123/2259] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:02:04 2021] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:04.734476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe982-493f-4379-84d5-3b68d7508921 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:04.903483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:04.904688 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.904981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.905606 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.905905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:04.907867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:04.952826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1137/2260] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:02:04 2021] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:04.958255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:04.971200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76189b-fce3-44cf-b32b-fbdef9a844b4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:04.984746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:04.985622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:04.986185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:04.986696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:04.989340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:04.991653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:05.015081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1124/2261] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:05.017300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:05.030792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b09b2-6658-4316-85b6-709faca7841c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:05.046700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:05.061650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:05.062084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:05.062469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:05.063309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:05.065510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eabbf-72c2-4763-9cba-2d97c23befd8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:05.078632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1138/2262] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:05 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:05.083118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:05.101282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e786c5-7ab7-4ce3-99c3-2ed12edc7263 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:05.106118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:05.108602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:05.108903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:05.109190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] PATH_INFO: `/v3/projects/e3d50e6f1eba4f93b1c3fafcbf7755fa/users/8a7dd9b2825b4907a6d69e72ae03daa3/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:05.135062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d50e6f1eba4f93b1c3fafcbf7755fa, user_id=8a7dd9b2825b4907a6d69e72ae03daa3, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:05.139447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:05.159400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1125/2263] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:02:05 2021] PUT /identity/v3/projects/e3d50e6f1eba4f93b1c3fafcbf7755fa/users/8a7dd9b2825b4907a6d69e72ae03daa3/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:05.171710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1571-0a99-4597-8b1b-4e88f3ac30da None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:05.172103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1571-0a99-4597-8b1b-4e88f3ac30da None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:05.172357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1571-0a99-4597-8b1b-4e88f3ac30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:05.260000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-cb0c1571-0a99-4597-8b1b-4e88f3ac30da None None] MFA Rules not processed for user `8a7dd9b2825b4907a6d69e72ae03daa3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:05.261239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-cb0c1571-0a99-4597-8b1b-4e88f3ac30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:05.439452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1139/2264] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:05 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:05.448460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:05.450094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:05.578472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072499-0e22-405d-a639-e8b9f914b9bc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:05.587327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:05.588338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:05.588582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:05.588861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:05.623757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:05.625432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:05.651471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1126/2265] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:05 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:05.721072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646148-ba0c-4781-8aa0-2261f44819ee None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:05.721365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646148-ba0c-4781-8aa0-2261f44819ee None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:05.721940 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646148-ba0c-4781-8aa0-2261f44819ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:05.816119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-11646148-ba0c-4781-8aa0-2261f44819ee None None] MFA Rules not processed for user `8073ab8f15c64c2e8adc6ce2cdc5d13c`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:05.818478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-11646148-ba0c-4781-8aa0-2261f44819ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:05.995458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1140/2266] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:05 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:06.115209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:06.116959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:06.299289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879dc71-4aec-4c8e-a494-8f68868ba7c9 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:06.316870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:06.317639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:06.318127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:06.318581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:06.320637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:06.461889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:06.463884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:06.476279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1127/2267] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:06 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:08.598218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7953-dec2-4497-92bb-feae1fcc9927 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:08.599119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7953-dec2-4497-92bb-feae1fcc9927 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:08.599634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7953-dec2-4497-92bb-feae1fcc9927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:08.628380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5ece7953-dec2-4497-92bb-feae1fcc9927 None None] MFA Rules not processed for user `e1f010313d3e4875994e8537e8c9c558`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:08.630264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5ece7953-dec2-4497-92bb-feae1fcc9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:08.644555 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1141/2268] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:08 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:10.139919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:10.234162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59cb6-dcbe-4a66-832d-6dc017c409b5 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:10.240286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:10.241484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:10.241921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:10.242342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] PATH_INFO: `/v3/users/8a7dd9b2825b4907a6d69e72ae03daa3` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:10.244903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7dd9b2825b4907a6d69e72ae03daa3)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:10.247898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:10.342637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7dd9b2825b4907a6d69e72ae03daa3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:10.353713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7dd9b2825b4907a6d69e72ae03daa3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:10.369329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7dd9b2825b4907a6d69e72ae03daa3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:10.370144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7dd9b2825b4907a6d69e72ae03daa3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:10.370909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7dd9b2825b4907a6d69e72ae03daa3'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:10.385687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1128/2269] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:02:10 2021] DELETE /identity/v3/users/8a7dd9b2825b4907a6d69e72ae03daa3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:10.392279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:10.392279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:10.392279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:10.424719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:10.425898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:10.527819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1142/2270] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:10.539416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:10.542521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:10.635631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3e647-73bd-4119-9f31-95d5f57a4c6c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:10.642240 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:10.642957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:10.643255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:10.643541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:10.654567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:10.656428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ae16a-f4fb-4387-9b39-dc125290580c service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:10.667673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1129/2271] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:11.073013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:11.075115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:11.087155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dc535-d65d-4a20-8fed-fe6558716b72 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:11.092548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:11.093342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:11.093631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:11.093904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] PATH_INFO: `/v3/projects/e3d50e6f1eba4f93b1c3fafcbf7755fa` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:11.095287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d50e6f1eba4f93b1c3fafcbf7755fa)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:11.097510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:11.162599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d50e6f1eba4f93b1c3fafcbf7755fa', 'request_id': 'req-b43c80e2-ac7c-4c0b-ba05-99204e284978'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:11.172603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d50e6f1eba4f93b1c3fafcbf7755fa', 'request_id': 'req-b43c80e2-ac7c-4c0b-ba05-99204e284978'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:11.184997 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d50e6f1eba4f93b1c3fafcbf7755fa', 'request_id': 'req-b43c80e2-ac7c-4c0b-ba05-99204e284978'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:11.195211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] The token cache is being invalidate because project e3d50e6f1eba4f93b1c3fafcbf7755fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:02:11.195494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:11.196273 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:11.197839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1143/2272] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:02:11 2021] DELETE /identity/v3/projects/e3d50e6f1eba4f93b1c3fafcbf7755fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:02:14.005651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:14.006324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:14.006324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:14.034664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] MFA Rules not processed for user `c023f89fd3da4bc8b38963bed4e5cc63`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:14.035792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:14.114079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1130/2273] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:14 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:23.219238 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:23.220645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:23.332034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c80e2-ac7c-4c0b-ba05-99204e284978 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:23.338305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:23.338895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:23.339170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:23.339466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:23.344116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:23.358396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:23.360077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f16a72-29d6-4b4b-a36f-6344f9e17aab service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:23.370604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1144/2274] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:25.358486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:25.360404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:25.434164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383a76f-3589-4447-9736-8fa99df94548 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:25.439225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:25.440071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:25.440383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:25.440653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] PATH_INFO: `/v3/users/8a570869a4df47fd93c908ccbcd0123c` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:25.441880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a570869a4df47fd93c908ccbcd0123c)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:25.443854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:25.494833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a570869a4df47fd93c908ccbcd0123c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:25.503429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a570869a4df47fd93c908ccbcd0123c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:25.515888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a570869a4df47fd93c908ccbcd0123c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:25.516557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a570869a4df47fd93c908ccbcd0123c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:25.517136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a570869a4df47fd93c908ccbcd0123c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:25.530606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1131/2275] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:02:25 2021] DELETE /identity/v3/users/8a570869a4df47fd93c908ccbcd0123c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:02:25.536328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:25.537372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:25.537654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:25.561481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:25.562666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:25.630859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1145/2276] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:25.641495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:25.642859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:25.715922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef170d1-fb7d-447b-819e-b813acb0b0b3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:25.721732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:25.722345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:25.722629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:25.722909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:25.734799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:25.736473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b01415-2fa5-47e3-bfd4-4c24f278d3a8 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:25.747135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1132/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:02:26.139450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.140941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:26.152462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a91c1-1c18-405b-84dc-565a2cd52b57 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.178637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.178637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.178637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.178637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] PATH_INFO: `/v3/projects/783a3b0c91fb4deb86f3df61ea30d708` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.179103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783a3b0c91fb4deb86f3df61ea30d708)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.179103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.228409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783a3b0c91fb4deb86f3df61ea30d708', 'request_id': 'req-081ec455-219b-4591-a855-934f4ccc5077'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:26.236825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783a3b0c91fb4deb86f3df61ea30d708', 'request_id': 'req-081ec455-219b-4591-a855-934f4ccc5077'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:26.248507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783a3b0c91fb4deb86f3df61ea30d708', 'request_id': 'req-081ec455-219b-4591-a855-934f4ccc5077'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:26.260122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] The token cache is being invalidate because project 783a3b0c91fb4deb86f3df61ea30d708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:02:26.260436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:26.261087 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-081ec455-219b-4591-a855-934f4ccc5077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:02:26.262645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1146/2278] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:02:26 2021] DELETE /identity/v3/projects/783a3b0c91fb4deb86f3df61ea30d708 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:26.268688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.269049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.269388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.295269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:26.296498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:26.369802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1133/2279] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:26.379099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.379395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.379728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.403246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:26.404735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:26.413371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1147/2280] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:26.417663 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.427990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef588e-1548-4f61-9fa9-b1101dd3d05c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.432655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.433498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.433949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.434386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.435498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:02:26.436058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.437922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.464625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1134/2281] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:02:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:02:26.468983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.480575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fa942-d5b4-4b39-8ba9-c164fbff81ad None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.487614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.488706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.488995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.489272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.489926 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.492075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.530448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1148/2282] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:02:26 2021] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:26.535281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.546346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24a23-2d8d-4af7-9c50-811415cc86ca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.619096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.619702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.619992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.620390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.621208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.623324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.651090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1135/2283] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:02:26 2021] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:02:26.652833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.663612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce135163-d1a6-4236-b99b-bbace4151272 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.687912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.687912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.687912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.687912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.688332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.688332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.694698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1149/2284] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:26 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:26.698954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.709043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2f246-ca4d-468e-8488-23064e6e2cab admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.713835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.714440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.714717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.714991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.715695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.717940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0d566-c2d3-4236-8c2d-35aaba662c3e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.729007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1136/2285] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:02:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:02:26.733532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.743497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7ceed-fbd9-44af-83e2-948cfd2a0121 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:26.748326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:26.749155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.749437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.749715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] PATH_INFO: `/v3/projects/96b09c74dba64217923e775851b78511/users/ab03fff0277540209997fce197af91e9/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.770877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b09c74dba64217923e775851b78511, user_id=ab03fff0277540209997fce197af91e9, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:26.773559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:26.789650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1150/2286] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:02:26 2021] PUT /identity/v3/projects/96b09c74dba64217923e775851b78511/users/ab03fff0277540209997fce197af91e9/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:02:26.800704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40820-ddc9-499d-84c4-0e2e8e067e9e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:26.801066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40820-ddc9-499d-84c4-0e2e8e067e9e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:26.801298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40820-ddc9-499d-84c4-0e2e8e067e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:26.855656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9aa40820-ddc9-499d-84c4-0e2e8e067e9e None None] MFA Rules not processed for user `ab03fff0277540209997fce197af91e9`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:26.857043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9aa40820-ddc9-499d-84c4-0e2e8e067e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:26.940582 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1137/2287] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:02:26 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:26.950544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:26.952332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:27.067748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e710-b21e-4948-9099-fb46e9c92118 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:27.071544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:27.072142 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:27.072452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:27.072732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:27.081873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:27.083324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:27.092449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1151/2288] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:02:26 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:02:50.155475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:50.156008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:50.156008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:50.235203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:02:50.236347 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:50.317971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1138/2289] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:02:50 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:02:50.369721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:02:50.371224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:02:50.481166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3113e-1e29-43cd-86a1-6a413d0e5aba service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:02:50.486389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:02:50.486947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:02:50.487235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:02:50.487518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:02:50.496267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:02:50.497880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac5141-ef0e-4d49-b360-e1862ef48232 service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:02:50.507371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1152/2290] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:02:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:10.213182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:10.333956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4384551-f1f8-433a-8e79-0a4792479090 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:10.348008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:10.349336 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:10.349815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:10.350257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] PATH_INFO: `/v3/users/ab03fff0277540209997fce197af91e9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:10.357872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab03fff0277540209997fce197af91e9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:10.360304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:10.507756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab03fff0277540209997fce197af91e9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:10.519878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab03fff0277540209997fce197af91e9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:10.537049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab03fff0277540209997fce197af91e9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:10.537529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab03fff0277540209997fce197af91e9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:10.538366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab03fff0277540209997fce197af91e9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:10.559946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1139/2291] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:10 2021] DELETE /identity/v3/users/ab03fff0277540209997fce197af91e9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:10.564384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:10.564983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:10.564983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:10.612053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:10.613532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:10.707687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1153/2292] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:10.718475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:10.720499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:10.813879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01412-6992-44b6-a9bc-d6f7cde72367 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:10.817618 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:10.818279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:10.818621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:10.818962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:10.828720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:10.830224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27bdc5-533a-40aa-aead-4c3691b7d2aa service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:10.840100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1140/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:11.271298 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:11.273025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:11.291100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23742c8-6bfc-41d2-baec-5076ae9dc56e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:11.296879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:11.297867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:11.298254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:11.299490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] PATH_INFO: `/v3/projects/96b09c74dba64217923e775851b78511` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:11.301772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b09c74dba64217923e775851b78511)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:11.305053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:11.421099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b09c74dba64217923e775851b78511', 'request_id': 'req-d41fbc8b-c95c-4e6c-8270-c3589ace196b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:11.432206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b09c74dba64217923e775851b78511', 'request_id': 'req-d41fbc8b-c95c-4e6c-8270-c3589ace196b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:11.447075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b09c74dba64217923e775851b78511', 'request_id': 'req-d41fbc8b-c95c-4e6c-8270-c3589ace196b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:11.460632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] The token cache is being invalidate because project 96b09c74dba64217923e775851b78511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:11.461220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:11.462462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d41fbc8b-c95c-4e6c-8270-c3589ace196b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:11.470592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1154/2294] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:11 2021] DELETE /identity/v3/projects/96b09c74dba64217923e775851b78511 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:11.472449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:11.473029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:11.473029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:11.508086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:11.510442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:11.712478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1141/2295] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:03:11.721661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:11.722913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:11.723360 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:11.760711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:11.761932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:11.771008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1155/2296] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:11.775199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:11.785810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3358a8-368a-49a8-8100-84905e1bac22 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:11.790574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:11.791241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:11.791625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:11.791808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:11.793482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:03:11.793482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:11.795005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:11.811856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1142/2297] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:03:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:03:11.817030 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:11.831507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83334a-1acc-4360-bfc4-618c9f36f50d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:11.845003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:11.845624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:11.846090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:11.846513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:11.847351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:11.849481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:11.920663 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1156/2298] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:11 2021] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:11.926468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:11.940910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96fa5-1658-45cc-9c60-8dc6be1dcbb5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:12.069120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:12.069968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.070270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.070625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.072321 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:12.076063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:12.113381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1143/2299] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:11 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:12.117282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:12.136983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751f70-948f-4114-b5b1-dcb3e9433065 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:12.146652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:12.147627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.147921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.148212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.150189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:12.151902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:12.174252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1157/2300] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:12 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:12.178022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:12.192641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc0278-7b56-4c63-bc57-62c111df7472 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:12.199406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:12.200202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.200488 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.200647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.201366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:12.203120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeedf36-a5fa-407a-bd9f-55483bde4efd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:12.217116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1144/2301] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:12.218380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:12.230704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201fe1-d9a3-4b22-b4a9-244252b47eb7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:12.238874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:12.239916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.240439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.240672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] PATH_INFO: `/v3/projects/13128fc1ba014300bfb802722969331f/users/b10dad24cdfa4e128b19e01548066a84/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.264927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13128fc1ba014300bfb802722969331f, user_id=b10dad24cdfa4e128b19e01548066a84, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:12.267931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:12.287379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1158/2302] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:12 2021] PUT /identity/v3/projects/13128fc1ba014300bfb802722969331f/users/b10dad24cdfa4e128b19e01548066a84/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:12.293820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089ba47-cac4-4eda-b4ce-a35039dbbf20 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.294202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089ba47-cac4-4eda-b4ce-a35039dbbf20 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.294566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089ba47-cac4-4eda-b4ce-a35039dbbf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.328417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a089ba47-cac4-4eda-b4ce-a35039dbbf20 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:12.329619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a089ba47-cac4-4eda-b4ce-a35039dbbf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:12.432914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1145/2303] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:12.443532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:12.445362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:12.559379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0845d-02bd-4a39-9ded-86d4250d4161 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:12.568729 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:12.569484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:12.569873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:12.570252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:12.580436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:12.582099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:12.595768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1159/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:14.729410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:14.730462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:14.730945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:14.802553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:14.807233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:14.906245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1146/2305] 10.222.0.60 () {58 vars in 967 bytes} [Tue Nov 23 13:03:14 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:14.923994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:14.925775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:15.064144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25f17a-4700-49b5-a3c9-7ccd6205813c service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:15.073183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:15.073959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:15.074348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:15.076067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:15.120307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:15.129699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:15.155648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1160/2306] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:03:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:18.252018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:18.254421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:18.274747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecadd5-bc56-4499-93d2-e1a067c3511e None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:18.281611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:18.282644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:18.283216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:18.283637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] PATH_INFO: `/v3/users/ec0fe7fa96d645ecbc1e50fb5595971d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:18.285450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0fe7fa96d645ecbc1e50fb5595971d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:18.287991 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:18.356570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0fe7fa96d645ecbc1e50fb5595971d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:18.368786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0fe7fa96d645ecbc1e50fb5595971d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:18.388025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0fe7fa96d645ecbc1e50fb5595971d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:18.389045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0fe7fa96d645ecbc1e50fb5595971d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:18.390114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-738aa1d3-d1ea-4e62-afa7-2d12e02ab81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0fe7fa96d645ecbc1e50fb5595971d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:18.412175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1147/2307] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:18 2021] DELETE /identity/v3/users/ec0fe7fa96d645ecbc1e50fb5595971d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:18.880011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:18.900611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb59eb5-6e8b-435c-b5df-8c96ae2a96ec service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.042278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.043435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.043914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.044391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] PATH_INFO: `/v3/projects/306daa81c2794164a38ae7bc3b322ef2` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.048045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] RBAC: Authorizing `identity:delete_project(project_id=306daa81c2794164a38ae7bc3b322ef2)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.064518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.176879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306daa81c2794164a38ae7bc3b322ef2', 'request_id': 'req-091959b7-e4c1-491e-9cea-3f010bdb623c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:19.190644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306daa81c2794164a38ae7bc3b322ef2', 'request_id': 'req-091959b7-e4c1-491e-9cea-3f010bdb623c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:19.214818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306daa81c2794164a38ae7bc3b322ef2', 'request_id': 'req-091959b7-e4c1-491e-9cea-3f010bdb623c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:19.226943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] The token cache is being invalidate because project 306daa81c2794164a38ae7bc3b322ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:19.227416 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:19.229172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-091959b7-e4c1-491e-9cea-3f010bdb623c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:19.231323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1161/2308] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:18 2021] DELETE /identity/v3/projects/306daa81c2794164a38ae7bc3b322ef2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:03:19.237070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.238576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.239461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.319610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:19.326596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:19.436990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1148/2309] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:19.445624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.445877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.446377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.478103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:19.489092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:19.499658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1162/2310] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:19.503827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.514501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d963-c2af-414b-92d5-6d455871f396 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.519585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.520418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.520797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.521170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.522170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:03:19.522737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.524622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.541536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1149/2311] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:03:19.545653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.554796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d658e8d-763a-48c2-815e-8dfba83e7cfd None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.559453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.560099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.560423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.560865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.561570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.565132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.605942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.606600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1163/2312] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:19 2021] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:19.628572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8f04-52d3-496e-ab2e-2bc876c79442 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.780956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.781877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.782873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.783264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.785047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.787992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.817431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1150/2313] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:19 2021] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:19.821268 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.835149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0cd1-7572-40db-908e-fce05aea5d51 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.841314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.841920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.842336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.842732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.843903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.847664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.862000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1164/2314] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:19.865940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.883699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2391f-4eb0-4db8-93df-8e5091f601ab admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.897055 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.897745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.898136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.898420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:19.899248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:19.901887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb3ef-faa7-4b1a-8df3-43d931ee2cbd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:19.917506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1151/2315] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:19.921919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:19.936641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887741b-6bd5-47af-9b1d-5ea40f56cc7c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:19.948933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:19.950697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:19.951147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:19.952344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] PATH_INFO: `/v3/projects/682b61854a484b10b65c9fcc50e2923c/users/55c33ad2d09c495983a8a8c17089e351/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:20.012837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682b61854a484b10b65c9fcc50e2923c, user_id=55c33ad2d09c495983a8a8c17089e351, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:20.016281 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:20.050216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1165/2316] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:19 2021] PUT /identity/v3/projects/682b61854a484b10b65c9fcc50e2923c/users/55c33ad2d09c495983a8a8c17089e351/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:03:20.062308 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f4ce-c58d-4726-9c39-fd965b3760be None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:20.062601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f4ce-c58d-4726-9c39-fd965b3760be None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:20.062887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f4ce-c58d-4726-9c39-fd965b3760be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:20.140797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-48e0f4ce-c58d-4726-9c39-fd965b3760be None None] MFA Rules not processed for user `55c33ad2d09c495983a8a8c17089e351`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:20.141979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-48e0f4ce-c58d-4726-9c39-fd965b3760be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:20.252871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1152/2317] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:20 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:20.264544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:20.266704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:20.415604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466ddc-0fc8-4cd3-b948-5c82edc418d4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:20.423110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:20.423356 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:20.423515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:20.423802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:20.445239 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:20.446794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:20.467644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1166/2318] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:20 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:21.098905 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.099393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.099634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.144718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] MFA Rules not processed for user `b10dad24cdfa4e128b19e01548066a84`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:21.145954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:21.223072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1153/2319] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:21 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:21.228092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.229706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:21.314700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d670c1-4f71-46a9-9f28-d303e1ecc1c1 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.319422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.320092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.320468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.320970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.321725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.323637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.352821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1167/2320] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:21 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:21.357448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.368549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a564-dffd-4a5a-903b-d334b7baa64f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.438345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.439356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.439799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.439971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.440753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.442669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.466421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1154/2321] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:21 2021] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:21.470818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.483795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e0cb-d0d8-4f83-88e7-7a16ba16d805 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.489951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.490581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.490862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.491135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.491864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.494123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.507702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1168/2322] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:21.516939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.529151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91156a-0f34-4b18-a92c-f35d490e8023 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.535041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.536038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.536423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.536767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] PATH_INFO: `/v3/projects/be308acf515d4669907fda5a4d8ac963/users/5626d4903bcb44fe999834f384f13f5f/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.559833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be308acf515d4669907fda5a4d8ac963, user_id=5626d4903bcb44fe999834f384f13f5f, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.562531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.578941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1155/2323] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:21 2021] PUT /identity/v3/projects/be308acf515d4669907fda5a4d8ac963/users/5626d4903bcb44fe999834f384f13f5f/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:21.582949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.593710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc2cc-eb5e-43e4-8197-370e55bc4328 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.664527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.665320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.665676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.666065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.666762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.668610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.679347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1169/2324] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:03:21.684062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:21.694679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d567cb-7662-4b03-9244-1682f97f27f5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:21.699897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:21.701906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:21.701906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:21.701906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] PATH_INFO: `/v3/projects/be308acf515d4669907fda5a4d8ac963/users/5626d4903bcb44fe999834f384f13f5f/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:21.706333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be308acf515d4669907fda5a4d8ac963, user_id=5626d4903bcb44fe999834f384f13f5f, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:21.709533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762553ba-0397-4ddb-aae5-2d3cc0784129 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:21.730593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1156/2325] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:21 2021] PUT /identity/v3/projects/be308acf515d4669907fda5a4d8ac963/users/5626d4903bcb44fe999834f384f13f5f/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:29.767346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:29.769272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:29.928018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb33-b714-4e21-9d19-36f08da53163 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:30.088826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:30.089900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:30.090355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:30.090638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:30.095541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:30.253272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:30.267955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:30.290879 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1170/2326] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:29 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:33.759597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de086295-7a4d-435d-bd86-5b0eff3297eb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:33.760204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de086295-7a4d-435d-bd86-5b0eff3297eb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:33.760204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de086295-7a4d-435d-bd86-5b0eff3297eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:33.828184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-de086295-7a4d-435d-bd86-5b0eff3297eb None None] MFA Rules not processed for user `5626d4903bcb44fe999834f384f13f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:33.829506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-de086295-7a4d-435d-bd86-5b0eff3297eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:33.919631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1157/2327] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:33 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:33.931668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:33.933600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:34.050698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87177-ad4e-4339-8d76-38d64e6726be service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:34.054756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:34.055655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:34.056541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:34.056943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:34.140265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:34.141907 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:34.156437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1171/2328] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:33 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:34.305100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:34.305531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:34.305984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:34.332839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:34.333695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:34.403601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1158/2329] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:03:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:34.417139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:34.418556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:34.505249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4243c-230e-45d4-b25a-66e9da88fec5 service glance] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:34.510513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:34.511284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:34.511571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:34.511863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:34.521190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:34.522814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:34.532888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1172/2330] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:03:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:43.145911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:43.147669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:43.279913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b670a8f-deab-4067-83a3-3853cd8175b6 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:43.286942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:43.287989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:43.288744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:43.288744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] PATH_INFO: `/v3/users/9285e1edf7ed42029c54bcc4f86abda7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:43.291612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9285e1edf7ed42029c54bcc4f86abda7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:43.293608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:43.373941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9285e1edf7ed42029c54bcc4f86abda7'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:43.386657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9285e1edf7ed42029c54bcc4f86abda7'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:43.407610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9285e1edf7ed42029c54bcc4f86abda7'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:43.408260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9285e1edf7ed42029c54bcc4f86abda7'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:43.408881 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6332d3ff-7fff-4b0d-8ae1-4f12280958dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9285e1edf7ed42029c54bcc4f86abda7'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:43.429710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1159/2331] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:43 2021] DELETE /identity/v3/users/9285e1edf7ed42029c54bcc4f86abda7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:03:43.787150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:43.803108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db881223-ed15-4a5e-83f1-669150bde424 service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:43.896085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:43.899195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:43.899585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:43.899973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] PATH_INFO: `/v3/projects/9bd7c1ce491e474c970f1a7cc5effe19` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:43.903059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd7c1ce491e474c970f1a7cc5effe19)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:43.906777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:43.993361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd7c1ce491e474c970f1a7cc5effe19', 'request_id': 'req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:44.010515 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd7c1ce491e474c970f1a7cc5effe19', 'request_id': 'req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:44.033169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd7c1ce491e474c970f1a7cc5effe19', 'request_id': 'req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:44.045084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] The token cache is being invalidate because project 9bd7c1ce491e474c970f1a7cc5effe19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:44.045636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:44.046450 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-35bff350-b8c3-4fe8-bbf5-9b3af598b4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:44.048660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1173/2332] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:43 2021] DELETE /identity/v3/projects/9bd7c1ce491e474c970f1a7cc5effe19 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:44.054203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.054854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.055362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.084787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:44.086115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:44.177535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1160/2333] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:03:44.186179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.186964 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.187257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.218955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:44.220293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:44.230520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1174/2334] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:44.234470 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.244638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f5005-4214-4fb2-b582-00722cc84a44 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.250007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.250778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.251162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.251540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.252343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:03:44.252723 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.254588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.270035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1161/2335] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:03:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:03:44.274785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.284517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c9b0-94be-4459-a1f5-0dca6ea80653 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.289170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.289779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.290062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.290338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.290993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.292987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.328716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1175/2336] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:44 2021] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:44.329715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.353054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953155d-2bee-4f34-990c-f9d8914d4054 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.434497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.435282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.435568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.435839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.436738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.438758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.466597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1162/2337] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:44 2021] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:44.470668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.487202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94186-97c0-47cb-9bc7-a9d4fc92b450 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.502706 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.502973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.503074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.503616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.504122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.505770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.530930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.532790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1176/2338] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:44 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:44.542683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128e27-819e-4390-b07a-f20da6ef7e60 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.547236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.548419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.548686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.549002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.549844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.554305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48458b6b-0b67-4b74-af79-4955cd793f1e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.569200 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1163/2339] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:44 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:44.575619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.591865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d912077-1698-4615-9c0d-c71994482088 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:44.597384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:44.598402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.599118 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.599410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] PATH_INFO: `/v3/projects/0ae6a02f9730467d9f1f2f1b6b622ed1/users/4a339e0f5f334e86a1668a65de73c652/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.628795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae6a02f9730467d9f1f2f1b6b622ed1, user_id=4a339e0f5f334e86a1668a65de73c652, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:44.631504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:44.659679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1177/2340] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:44 2021] PUT /identity/v3/projects/0ae6a02f9730467d9f1f2f1b6b622ed1/users/4a339e0f5f334e86a1668a65de73c652/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:44.661630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:44.662090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:44.663464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:44.691403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:44.693003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:44.954894 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1164/2341] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:44.962322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:44.964282 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:45.067384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2ec2-bd13-4cff-8818-7aae4e110d71 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:45.071640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:45.072262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:45.072579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:45.072900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:45.088631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:45.092363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:45.103821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1178/2342] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:45.674228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:45.676718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:45.696150 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a834ac-227c-4477-a229-87c6656e0465 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:45.702405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:45.703669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:45.704116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:45.704672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] PATH_INFO: `/v3/users/c023f89fd3da4bc8b38963bed4e5cc63` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:45.709552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c023f89fd3da4bc8b38963bed4e5cc63)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:45.716636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:45.828528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c023f89fd3da4bc8b38963bed4e5cc63'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:45.847549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c023f89fd3da4bc8b38963bed4e5cc63'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:45.874690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c023f89fd3da4bc8b38963bed4e5cc63'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:45.875649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c023f89fd3da4bc8b38963bed4e5cc63'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:45.879362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f5c4805e-5e52-4a24-8cfd-4b6169d1676c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c023f89fd3da4bc8b38963bed4e5cc63'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:45.918047 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1165/2343] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:45 2021] DELETE /identity/v3/users/c023f89fd3da4bc8b38963bed4e5cc63 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:46.290337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:46.308005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fca2d-0135-4aab-b083-c1dbb7705c0e service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:46.474519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:46.475350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.475640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.475923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] PATH_INFO: `/v3/projects/9a31364455dc442f8df299a8ad758a4e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.477331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a31364455dc442f8df299a8ad758a4e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:46.479319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:46.561322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a31364455dc442f8df299a8ad758a4e', 'request_id': 'req-d4928af7-468c-4efc-acde-338a820ea9ed'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:46.583065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a31364455dc442f8df299a8ad758a4e', 'request_id': 'req-d4928af7-468c-4efc-acde-338a820ea9ed'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:46.614694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a31364455dc442f8df299a8ad758a4e', 'request_id': 'req-d4928af7-468c-4efc-acde-338a820ea9ed'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:46.640781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] The token cache is being invalidate because project 9a31364455dc442f8df299a8ad758a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:46.641108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:46.641777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4928af7-468c-4efc-acde-338a820ea9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:46.646036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1179/2344] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:46 2021] DELETE /identity/v3/projects/9a31364455dc442f8df299a8ad758a4e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:46.653654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.653928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.654238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.678259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:46.679691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:46.785192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1166/2345] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:46.797399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.797846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.798236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.837451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:46.839077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:46.849319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1180/2346] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:46.855720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:46.875739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a82add-9b27-4aa2-a234-20f02f172d30 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:46.895338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:46.896130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.896531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.896907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.899866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:03:46.900380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:46.907238 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e35a54-258c-48e1-abac-7b8c20b003fb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:46.935107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1167/2347] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:03:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:03:46.947217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:46.951245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.951812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.952377 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.959365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554ce9-e01d-407e-9b50-c32102be6746 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:46.972063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:46.972705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:46.972993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:46.973286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:46.973939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:46.975859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.020557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1181/2348] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:46 2021] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:47.024527 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.042948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] MFA Rules not processed for user `4a339e0f5f334e86a1668a65de73c652`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:47.045392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:47.163383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdacd8-a6ff-4256-a8f6-560a72414339 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.170769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.171727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.172363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.172982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.173799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.176789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.222939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1168/2349] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:46 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:47.225164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.227640 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:47.239919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1182/2350] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:47 2021] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:47.244634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.252174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b69870-f15b-444a-840a-d0d9219a977d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.257433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d37bb-7e11-4a23-a66e-1a2b813bfc67 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.257998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.258863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.259287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.259686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.260643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.262805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.272756 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.273719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.274172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.274896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.275960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.277883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.293811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1183/2351] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:03:47.298982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.314524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1169/2352] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:47 2021] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:47.321754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.334104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7812f-33b8-44e3-a3ed-3cd2bf3d9a23 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.448076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.448749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.449038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.449320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.450021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.451878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.465689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1184/2353] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:47.470109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.481980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346d17-d41f-4f17-86fa-93cbfd420e20 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.482562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977c99-5259-483f-b4d2-0abd875358c9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.490686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.491960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.492553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.492923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.493170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.493457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.493726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] PATH_INFO: `/v3/projects/da4a0655e30c4623a8ec32e708b41253/users/a1456434cf834594ad30b827298892d3/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.493851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.494680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.503428 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.522156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4a0655e30c4623a8ec32e708b41253, user_id=a1456434cf834594ad30b827298892d3, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.526406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c60ca4-b5f7-4dcd-9119-85ec04999d50 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.540304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1170/2354] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:47 2021] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:47.543230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.555359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1185/2355] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:47 2021] PUT /identity/v3/projects/da4a0655e30c4623a8ec32e708b41253/users/a1456434cf834594ad30b827298892d3/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:47.558096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903131da-01f8-48e1-9912-2031e9fc55d8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.568068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.568444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.569576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.641986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] MFA Rules not processed for user `a1456434cf834594ad30b827298892d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:47.643270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:47.657528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.658717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.659170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.659625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.660527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.662328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.675284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1171/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:47.679597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.693161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f554c-cb0f-443d-a95c-f7378e168497 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.698469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.699536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.699822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.700344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] PATH_INFO: `/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3/users/071f3bc2a0474ae7abfc0911bcbb2a4f/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.726038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1276c869db1e4aa1ae8f202c9d83e5f3, user_id=071f3bc2a0474ae7abfc0911bcbb2a4f, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.730062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.770230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1172/2357] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:47 2021] PUT /identity/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3/users/071f3bc2a0474ae7abfc0911bcbb2a4f/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:47.770546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1186/2358] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:47 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:47.771508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.783618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.785923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:47.885776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2869a2e-4657-438e-9de3-e2be344406c4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.896652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.898844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.899224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.899597 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.903777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.905658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.942063 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1173/2359] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:03:47.943318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:47.956284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73863037-1403-4fda-8d47-e58014fdb0fb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:47.962221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:47.963203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:47.963588 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:47.963968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] PATH_INFO: `/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3/users/071f3bc2a0474ae7abfc0911bcbb2a4f/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:47.966372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1276c869db1e4aa1ae8f202c9d83e5f3, user_id=071f3bc2a0474ae7abfc0911bcbb2a4f, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:47.969215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a06fc6-2e8d-4bf1-9abb-1b9cff2ce5a1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:47.991429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1174/2360] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:47 2021] PUT /identity/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3/users/071f3bc2a0474ae7abfc0911bcbb2a4f/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:48.030389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db69d1-01d4-4575-b362-095d6618e551 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:48.174624 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:48.175127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:48.175417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:48.175702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:48.301631 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:48.303893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c63c9-47dd-4ea3-822e-c3c4d6257674 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:48.315724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1187/2361] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:47 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:03:49.219283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:49.219889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:49.220032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:49.265973 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] MFA Rules not processed for user `071f3bc2a0474ae7abfc0911bcbb2a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:49.267523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:49.414332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1175/2362] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:49 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:50.474979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed294-396b-4528-a21e-f16bb278032e None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:50.475570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed294-396b-4528-a21e-f16bb278032e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:50.475570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed294-396b-4528-a21e-f16bb278032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:50.505258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-38eed294-396b-4528-a21e-f16bb278032e None None] MFA Rules not processed for user `b10dad24cdfa4e128b19e01548066a84`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:50.506664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-38eed294-396b-4528-a21e-f16bb278032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:50.582360 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1188/2363] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:50 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:51.715629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:51.797030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954545-c615-490b-8d63-0337cf69f2ca None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:51.802593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:51.803422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:51.803715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:51.804009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] PATH_INFO: `/v3/users/4a339e0f5f334e86a1668a65de73c652` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:51.806418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a339e0f5f334e86a1668a65de73c652)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:51.808658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:51.879004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a339e0f5f334e86a1668a65de73c652'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:51.888167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a339e0f5f334e86a1668a65de73c652'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:51.903337 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a339e0f5f334e86a1668a65de73c652'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:51.904104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a339e0f5f334e86a1668a65de73c652'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:51.904741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a339e0f5f334e86a1668a65de73c652'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:51.921587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1176/2364] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:51 2021] DELETE /identity/v3/users/4a339e0f5f334e86a1668a65de73c652 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:52.204547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed294-396b-4528-a21e-f16bb278032e None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:52.230891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed294-396b-4528-a21e-f16bb278032e None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:52.303147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:52.303959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:52.304299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:52.304579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] PATH_INFO: `/v3/projects/0ae6a02f9730467d9f1f2f1b6b622ed1` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:52.305708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae6a02f9730467d9f1f2f1b6b622ed1)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:52.307686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:52.365177 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae6a02f9730467d9f1f2f1b6b622ed1', 'request_id': 'req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.375858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae6a02f9730467d9f1f2f1b6b622ed1', 'request_id': 'req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.388716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae6a02f9730467d9f1f2f1b6b622ed1', 'request_id': 'req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.399037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] The token cache is being invalidate because project 0ae6a02f9730467d9f1f2f1b6b622ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:52.399311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.399951 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.401502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1189/2365] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:52 2021] DELETE /identity/v3/projects/0ae6a02f9730467d9f1f2f1b6b622ed1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:03:52.405737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:52.407214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:52.420311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bdd9-bc30-41b5-abdd-732f51abd9c8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:52.484890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:52.485634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:52.485922 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:52.486203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] PATH_INFO: `/v3/users/071f3bc2a0474ae7abfc0911bcbb2a4f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:52.487449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=071f3bc2a0474ae7abfc0911bcbb2a4f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:52.489421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:52.542540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071f3bc2a0474ae7abfc0911bcbb2a4f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.552398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071f3bc2a0474ae7abfc0911bcbb2a4f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.565519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071f3bc2a0474ae7abfc0911bcbb2a4f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.566221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071f3bc2a0474ae7abfc0911bcbb2a4f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.566823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4937d655-0610-4602-83ac-d626aa428a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071f3bc2a0474ae7abfc0911bcbb2a4f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:52.580789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1177/2366] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:03:52 2021] DELETE /identity/v3/users/071f3bc2a0474ae7abfc0911bcbb2a4f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:52.959250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:52.961125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:52.974494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c24d5-c7c7-4efe-9d0e-33ef46d9c78e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.042594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.043421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.043775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.044038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] PATH_INFO: `/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.045321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1276c869db1e4aa1ae8f202c9d83e5f3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.047295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.106610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1276c869db1e4aa1ae8f202c9d83e5f3', 'request_id': 'req-9d75a69e-1535-4e31-85f1-d604e03cf89c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:53.115155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1276c869db1e4aa1ae8f202c9d83e5f3', 'request_id': 'req-9d75a69e-1535-4e31-85f1-d604e03cf89c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:53.128646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1276c869db1e4aa1ae8f202c9d83e5f3', 'request_id': 'req-9d75a69e-1535-4e31-85f1-d604e03cf89c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:53.147109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] The token cache is being invalidate because project 1276c869db1e4aa1ae8f202c9d83e5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:03:53.148155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:53.148990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9d75a69e-1535-4e31-85f1-d604e03cf89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:03:53.150772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1190/2367] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:03:52 2021] DELETE /identity/v3/projects/1276c869db1e4aa1ae8f202c9d83e5f3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:53.157016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.157567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.157947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.184372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:53.184372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:53.258355 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1178/2368] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:53.266487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.267107 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.267317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.296613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:53.298260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:53.312347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1191/2369] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:53.316507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.330432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0770d-3d7a-4155-83ed-8cc14c0ee84c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.337525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.338178 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.338657 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.339094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.340007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:03:53.340509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.342422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.377026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1179/2370] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:03:53.378511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.395808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73dbf2-2957-4382-91d2-50e1b62a64b8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.405393 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.406013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.406301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.406592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.407245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.409229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff83bbb-9d56-4bb9-b74e-43db3eeca544 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.452805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1192/2371] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:53.456026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.472469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef2841-8422-459d-b198-ca36b219bd08 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.585847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.586464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.586896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.587186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.587872 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.590447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.600861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.601499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.602310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.625950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1180/2372] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:03:53.629758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.630946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:53.632199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:53.646400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004749-7ce7-4567-a66b-4584cb49d8ff admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.652419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.653272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.653755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.654215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.655077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.657011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.689632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1181/2373] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:53.690930 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.701873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e92f4-eb6a-419f-8885-eca63dcc6448 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.706564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.707329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.707616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.708509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.708896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.711397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.725214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1182/2374] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:53.729673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.739811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1193/2375] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:53.740540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cb1c0-5c7f-4520-9b46-330132d7a4f8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:53.745309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:53.748990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.748990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.748990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] PATH_INFO: `/v3/projects/b3dbcfde7bdd4fa0b8b72f212ea3133a/users/6ebddf69f6c74a15a6ffed1aacccea6a/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.775620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dbcfde7bdd4fa0b8b72f212ea3133a, user_id=6ebddf69f6c74a15a6ffed1aacccea6a, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:53.779437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf4bed-09dd-47be-948b-506e5a71d211 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:53.783520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:53.785115 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:53.795814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1183/2376] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:53 2021] PUT /identity/v3/projects/b3dbcfde7bdd4fa0b8b72f212ea3133a/users/6ebddf69f6c74a15a6ffed1aacccea6a/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:03:53.808775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:53.809239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:53.809653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:53.868357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] MFA Rules not processed for user `6ebddf69f6c74a15a6ffed1aacccea6a`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:53.870756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:53.903503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f266-d5ee-4273-bd6e-6d5890e68a5b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.017844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.020226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.020735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.022064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.084176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1184/2377] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:54.088738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.180169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.181953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.191842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1194/2378] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:03:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 13:03:54.197016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4053615-f7ac-466c-b628-e793b36e30e3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.202938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.203899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.204277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.204606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.205325 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.207815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.265384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1185/2379] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:03:54 2021] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:54.269700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.281642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e59f9-c7be-4a6c-a778-45499f8d08ff service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.360891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.361846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.362280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.363588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.364449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.366562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.406867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1195/2380] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:03:54 2021] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:03:54.411521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.430907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206574bb-f721-47e7-8ba4-e8b0c63f53f3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.435538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.436155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.436458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.436739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.437608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.440067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.461820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1186/2381] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:54.465832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.485222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2a6c-3d51-4c15-9c69-e54a01aa91a3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.496662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.498346 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.498783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.499205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] PATH_INFO: `/v3/projects/21cb443228d1443a83f6e004181c832b/users/28454100677546e6a2df8a09107aad82/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.529772 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cb443228d1443a83f6e004181c832b, user_id=28454100677546e6a2df8a09107aad82, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.533425 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.566592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1196/2382] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:54 2021] PUT /identity/v3/projects/21cb443228d1443a83f6e004181c832b/users/28454100677546e6a2df8a09107aad82/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:54.573332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.586262 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7677d4-b4e6-46b3-a993-f663d1103fc0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.719203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.720153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.720648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.721534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.722555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.724815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1a316-6b5f-41a8-bf98-c2142ef75271 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.739564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1187/2383] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:03:54.744283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:54.757793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de641f-5ed2-4c1d-aedc-e1f7b07f5023 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:54.769072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:54.769731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.770111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.770468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] PATH_INFO: `/v3/projects/21cb443228d1443a83f6e004181c832b/users/28454100677546e6a2df8a09107aad82/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.772910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cb443228d1443a83f6e004181c832b, user_id=28454100677546e6a2df8a09107aad82, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:54.775843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:54.799455 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1197/2384] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:03:54 2021] PUT /identity/v3/projects/21cb443228d1443a83f6e004181c832b/users/28454100677546e6a2df8a09107aad82/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:03:54.812123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:54.812482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:54.812835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:54.878887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] MFA Rules not processed for user `28454100677546e6a2df8a09107aad82`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:54.880852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:55.045866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1188/2385] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:03:54 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:55.054613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:55.059819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:55.196971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55780d8b-cce4-4465-9145-75a6844201df admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:55.201774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:55.202846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:55.203636 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:55.203985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:55.218021 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:55.219923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c6200-d109-4fc8-bf34-dff22cfc6f4b service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:55.250743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1198/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:55 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:55.418747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:55.430956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c2dc5-5d86-4ec1-b026-2e3a2bce6268 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:55.434572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:55.435363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:55.435932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:55.436402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:55.537918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:55.540517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:55.581072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1189/2387] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:03:55 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:03:56.499104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:56.501118 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:56.501701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:56.540326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:03:56.550535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:03:56.642675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1199/2388] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:03:56 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:03:56.657758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:03:56.797243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45262e08-12cd-46d8-b5fe-6f46017abfb8 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:03:56.805979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:03:56.807397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:03:56.807927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:03:56.808453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:03:56.820742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:03:56.822654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa9b3-ccf8-40ab-bfee-00f973eea1a1 service swift] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:03:56.832619 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1190/2389] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:03:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:04:11.198015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:11.199507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:11.274191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04ef77-f7f0-4bd8-a053-170c202504c8 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:11.278830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:11.279648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:11.279929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:11.280198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] PATH_INFO: `/v3/users/a1456434cf834594ad30b827298892d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:11.281369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1456434cf834594ad30b827298892d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:11.283313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:11.363188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1456434cf834594ad30b827298892d3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:11.385495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1456434cf834594ad30b827298892d3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:11.404900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1456434cf834594ad30b827298892d3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:11.405664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1456434cf834594ad30b827298892d3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:11.406310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1456434cf834594ad30b827298892d3'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:11.423280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1200/2390] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:11 2021] DELETE /identity/v3/users/a1456434cf834594ad30b827298892d3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:11.427825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:11.428444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:11.428444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:11.461077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:11.462520 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:11.537574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1191/2391] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:11.548751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:11.550516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:11.631484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cf0b-a31f-4d3f-9123-0f2d28a159a4 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:11.635442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:11.636114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:11.636528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:11.636867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:11.647693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:11.649215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b82d9-aac9-492f-b33e-31a0b1ddb786 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:11.659911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1201/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:12.424128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:12.427394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:12.441067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c27e8-7751-4b15-b472-cf2a0a757867 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:12.445856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:12.446765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.447307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.447307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] PATH_INFO: `/v3/projects/da4a0655e30c4623a8ec32e708b41253` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.448481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4a0655e30c4623a8ec32e708b41253)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:12.450525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:12.529058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4a0655e30c4623a8ec32e708b41253', 'request_id': 'req-e7335b79-5823-434f-8e9d-e34566a19559'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:12.539775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4a0655e30c4623a8ec32e708b41253', 'request_id': 'req-e7335b79-5823-434f-8e9d-e34566a19559'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:12.553455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4a0655e30c4623a8ec32e708b41253', 'request_id': 'req-e7335b79-5823-434f-8e9d-e34566a19559'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:12.565439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] The token cache is being invalidate because project da4a0655e30c4623a8ec32e708b41253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:12.565734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:12.566382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e7335b79-5823-434f-8e9d-e34566a19559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:12.567859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1192/2393] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:12 2021] DELETE /identity/v3/projects/da4a0655e30c4623a8ec32e708b41253 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:12.575457 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.576731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.577045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.601156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:12.602669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:12.685210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1202/2394] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:12.692677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.692969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.693252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.717655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:12.719104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:12.730527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1193/2395] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:12.731376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:12.741986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f960da2-197f-4ceb-80bd-1a7f6fc93592 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:12.747446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:12.749715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.750575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.751012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.751750 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:12.752103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:12.753933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:12.767485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1203/2396] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:12.771966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:12.781258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19e90c-af25-4dca-a9ec-d5faaf95b013 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:12.785578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:12.786161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.786439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.786717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.787357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:12.789292 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:12.818989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1194/2397] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:12 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:12.823203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:12.833284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3a237-9f75-49f3-aa69-9aa743417a68 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:12.915550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:12.916354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.916645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.918285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.918285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:12.919590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:12.946549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1204/2398] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:12 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:12.947058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:12.963143 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d990d1-5dc3-45e4-848b-078fda449244 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:12.967966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:12.968772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:12.969127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:12.969465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:12.970248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:12.971952 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:12.989061 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1195/2399] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:12.990540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.009440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5837-fd1b-4d3e-822e-b9e4cc5e83d7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.025099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.025751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.026048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.026341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.027042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.028914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ba434-1618-4777-be64-d0573d861137 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.043556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1205/2400] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:13.045244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.057425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2851-ed79-4ca8-aad9-f3398b6fbc9f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.063318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.064862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.065151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.065432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] PATH_INFO: `/v3/projects/66f7aaac4c484e60ad29b14645fccd6b/users/81c060b960904155accecb4934642bda/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.087267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f7aaac4c484e60ad29b14645fccd6b, user_id=81c060b960904155accecb4934642bda, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.090699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.109812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1196/2401] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:13 2021] PUT /identity/v3/projects/66f7aaac4c484e60ad29b14645fccd6b/users/81c060b960904155accecb4934642bda/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:13.127006 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.127318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.127601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.168065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] MFA Rules not processed for user `81c060b960904155accecb4934642bda`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:13.169313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:13.245655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1206/2402] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:13 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:13.250510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.320137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77150e4-b590-4821-a55f-b2148a402b30 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.325191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.325803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.326100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.326382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.327034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.329116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.361053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1197/2403] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:13 2021] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:13.364943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.378649 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37da4a-ba26-41a8-b867-dec13d3c5fdc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.489338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.493056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.493968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.494830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.495617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.498131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.532514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1207/2404] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:13 2021] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:13.536539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.548067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a305-d361-456d-b5c0-2e2a5f3d5f90 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.553419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.554052 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.554378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.554661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.555363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.557275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.576329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1198/2405] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:13.577344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.588884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5a2fe-a298-4a92-8358-5390f876055a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.599208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.600780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.601227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.601662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] PATH_INFO: `/v3/projects/f22bed794dea4172ac759643cf9decf8/users/0333cd40bd9841eba8423bf7fd49fc92/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.658188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22bed794dea4172ac759643cf9decf8, user_id=0333cd40bd9841eba8423bf7fd49fc92, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.661068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.680857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1208/2406] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:13 2021] PUT /identity/v3/projects/f22bed794dea4172ac759643cf9decf8/users/0333cd40bd9841eba8423bf7fd49fc92/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:13.689108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.717908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620fc2-57c0-4a9a-815f-03cecbda4155 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.807566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.808549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.809001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.809459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.811988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.814764 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c4d10-eda4-4bde-b831-5a2cd40fd82d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.829468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1199/2407] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:13.833348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:13.846452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21841cb-25e3-484f-ac48-3183aff5954d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:13.851732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:13.853265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.853739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.854182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] PATH_INFO: `/v3/projects/f22bed794dea4172ac759643cf9decf8/users/0333cd40bd9841eba8423bf7fd49fc92/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.858845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22bed794dea4172ac759643cf9decf8, user_id=0333cd40bd9841eba8423bf7fd49fc92, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:13.861993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:13.874352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1209/2408] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:13 2021] PUT /identity/v3/projects/f22bed794dea4172ac759643cf9decf8/users/0333cd40bd9841eba8423bf7fd49fc92/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:13.885186 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:13.885490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:13.885771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:13.928462 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] MFA Rules not processed for user `0333cd40bd9841eba8423bf7fd49fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:13.928847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:14.010923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1200/2409] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:13 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:14.021539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:14.023513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:14.091676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570821d-390d-426a-ab36-910b36f37b7e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:14.095348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:14.095965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:14.096274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:14.096603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:14.106073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:14.107605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf09863-6140-4f47-9dd5-a68f219a3489 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:14.116899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1210/2410] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:14 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:14.462860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:14.534452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad682853-991c-4fe3-8d7f-96f38f6e6201 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:14.539584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:14.540461 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:14.540756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:14.541031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] PATH_INFO: `/v3/users/81c060b960904155accecb4934642bda` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:14.542215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c060b960904155accecb4934642bda)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:14.544204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:14.593665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c060b960904155accecb4934642bda'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:14.601167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c060b960904155accecb4934642bda'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:14.612404 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c060b960904155accecb4934642bda'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:14.612948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c060b960904155accecb4934642bda'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:14.613527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c060b960904155accecb4934642bda'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:14.627686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1201/2411] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:14 2021] DELETE /identity/v3/users/81c060b960904155accecb4934642bda => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:14.632427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:14.632925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:14.633027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:14.657697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:14.658873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:14.725370 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1211/2412] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:14.736273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:14.737857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:14.803651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79608-59c7-449d-aa87-e2823ee2ea08 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:14.808296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:14.809168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:14.809560 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:14.809929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:14.819990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:14.821622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:14.830780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1202/2413] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:15.221300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:15.222875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:15.232062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:15.233444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:15.236958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e193e-9ca0-4f40-9677-83cadafc1395 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:15.242392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:15.243474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:15.243917 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:15.244205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] PATH_INFO: `/v3/users/6ebddf69f6c74a15a6ffed1aacccea6a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:15.245646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebddf69f6c74a15a6ffed1aacccea6a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:15.248139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:15.256673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8877-8e4c-4d0a-8f92-5c068e559063 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:15.261534 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:15.262319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:15.262601 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:15.262874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] PATH_INFO: `/v3/projects/66f7aaac4c484e60ad29b14645fccd6b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:15.263988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f7aaac4c484e60ad29b14645fccd6b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:15.265951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:15.307708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebddf69f6c74a15a6ffed1aacccea6a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.315389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebddf69f6c74a15a6ffed1aacccea6a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.320672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f7aaac4c484e60ad29b14645fccd6b', 'request_id': 'req-4723e669-a12e-464b-8a31-d8aba6de66a4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.328943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f7aaac4c484e60ad29b14645fccd6b', 'request_id': 'req-4723e669-a12e-464b-8a31-d8aba6de66a4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.329928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebddf69f6c74a15a6ffed1aacccea6a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.330878 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebddf69f6c74a15a6ffed1aacccea6a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.331769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-13d4c60d-f57f-42c8-b015-daca2bce1b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebddf69f6c74a15a6ffed1aacccea6a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.347779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f7aaac4c484e60ad29b14645fccd6b', 'request_id': 'req-4723e669-a12e-464b-8a31-d8aba6de66a4'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.350252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1212/2414] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:15 2021] DELETE /identity/v3/users/6ebddf69f6c74a15a6ffed1aacccea6a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:15.355392 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:15.355767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:15.356226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:15.359475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] The token cache is being invalidate because project 66f7aaac4c484e60ad29b14645fccd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:15.359770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.360454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.362381 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1203/2415] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:15 2021] DELETE /identity/v3/projects/66f7aaac4c484e60ad29b14645fccd6b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:15.366101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:15.367450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:15.382860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:15.383967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:15.440604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e669-a12e-464b-8a31-d8aba6de66a4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:15.453817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1213/2416] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:15.461095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:15.462411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:15.506237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:15.507152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:15.507528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:15.507876 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] PATH_INFO: `/v3/users/0333cd40bd9841eba8423bf7fd49fc92` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:15.509647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0333cd40bd9841eba8423bf7fd49fc92)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:15.511791 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:15.529196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1bada-09c6-4bc6-b4c9-fad619bab8a7 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:15.533158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:15.533765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:15.534050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:15.534327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:15.544394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:15.545884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:15.557134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1214/2417] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:15.580981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0333cd40bd9841eba8423bf7fd49fc92'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.590415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0333cd40bd9841eba8423bf7fd49fc92'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.604326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0333cd40bd9841eba8423bf7fd49fc92'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.605133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0333cd40bd9841eba8423bf7fd49fc92'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.605745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0333cd40bd9841eba8423bf7fd49fc92'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:15.630507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1204/2418] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:15 2021] DELETE /identity/v3/users/0333cd40bd9841eba8423bf7fd49fc92 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:16.019720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.023039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.036175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15be8-f119-41e5-8fdc-e0d387ab275b service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.108680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.109545 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.109830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.110108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] PATH_INFO: `/v3/projects/b3dbcfde7bdd4fa0b8b72f212ea3133a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.111271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3dbcfde7bdd4fa0b8b72f212ea3133a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.113246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.133978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.135471 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.148600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6864aa-460b-4842-9b8a-b74565a2a985 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.154160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.155540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.156002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.156465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] PATH_INFO: `/v3/projects/f22bed794dea4172ac759643cf9decf8` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.157743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22bed794dea4172ac759643cf9decf8)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.160064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.169813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3dbcfde7bdd4fa0b8b72f212ea3133a', 'request_id': 'req-4f8c762f-a509-483c-a5fc-3e611f68725d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.177680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3dbcfde7bdd4fa0b8b72f212ea3133a', 'request_id': 'req-4f8c762f-a509-483c-a5fc-3e611f68725d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.193516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3dbcfde7bdd4fa0b8b72f212ea3133a', 'request_id': 'req-4f8c762f-a509-483c-a5fc-3e611f68725d'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.206082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] The token cache is being invalidate because project b3dbcfde7bdd4fa0b8b72f212ea3133a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:16.206369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.207028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.209031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1215/2419] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:16 2021] DELETE /identity/v3/projects/b3dbcfde7bdd4fa0b8b72f212ea3133a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:16.212992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.214294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.215644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22bed794dea4172ac759643cf9decf8', 'request_id': 'req-b75ff143-1885-4ab6-bc31-25b4150ffa8f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.224865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22bed794dea4172ac759643cf9decf8', 'request_id': 'req-b75ff143-1885-4ab6-bc31-25b4150ffa8f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.236838 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22bed794dea4172ac759643cf9decf8', 'request_id': 'req-b75ff143-1885-4ab6-bc31-25b4150ffa8f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.247882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] The token cache is being invalidate because project f22bed794dea4172ac759643cf9decf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:16.248258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.249110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-b75ff143-1885-4ab6-bc31-25b4150ffa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.251023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1205/2420] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:16 2021] DELETE /identity/v3/projects/f22bed794dea4172ac759643cf9decf8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:16.256709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8f-e665-4cb7-bb46-3a9e2ea1f73d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.257000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8f-e665-4cb7-bb46-3a9e2ea1f73d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.257281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39f8f-e665-4cb7-bb46-3a9e2ea1f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.279704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-01d39f8f-e665-4cb7-bb46-3a9e2ea1f73d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:16.280899 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-01d39f8f-e665-4cb7-bb46-3a9e2ea1f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.285111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c762f-a509-483c-a5fc-3e611f68725d admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.350177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1206/2421] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:16.350536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.351468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.351811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.352148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] PATH_INFO: `/v3/users/28454100677546e6a2df8a09107aad82` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.353813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28454100677546e6a2df8a09107aad82)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.356086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.358366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.358739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.359102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.386571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:16.387921 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.397469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1207/2422] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:16.401631 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.408846 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28454100677546e6a2df8a09107aad82'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.410572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5faae2-cf23-47b1-996b-15066b335304 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.416334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.416997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.417293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.417585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.418319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:16.418692 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.420326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.427108 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28454100677546e6a2df8a09107aad82'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.434057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1208/2423] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:16.438467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.440150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28454100677546e6a2df8a09107aad82'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.440862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28454100677546e6a2df8a09107aad82'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.441481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28454100677546e6a2df8a09107aad82'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:16.448160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ffd4-db67-4c3c-8f49-057c7bd121c3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.452591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.453165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.453452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.453734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.454435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.454634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1216/2424] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:16 2021] DELETE /identity/v3/users/28454100677546e6a2df8a09107aad82 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:16.456374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.489909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1209/2425] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:16.491396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.492787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.570475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e8f2-7ad7-4829-a2a0-97ac97b78832 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.635390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.636002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.636319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.636597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.637245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.639214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.662517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1217/2426] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:16.666745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.677695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde68e-536f-4d85-9da3-ee0005dc0973 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.682376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.683094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.683474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.683848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.684718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.686397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.696851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1210/2427] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:16.700810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.710247 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e616-60dc-4ac8-ad1d-4830d4dbbb72 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.714639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.715242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.715532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.715813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.716544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.718163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a138-d214-42ad-b208-bc60ef5a06da admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.728893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1218/2428] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:16.733139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.743825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2bc17-2c93-4910-9f0c-b837504db7e6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.748637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.749649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.749990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.750359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] PATH_INFO: `/v3/projects/5ede48bd20d84d68a089590a0c35b1ee/users/65bccf2b909f4fd09f6a9fa1e28b8f90/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.772196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ede48bd20d84d68a089590a0c35b1ee, user_id=65bccf2b909f4fd09f6a9fa1e28b8f90, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.776688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.799023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1211/2429] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:16 2021] PUT /identity/v3/projects/5ede48bd20d84d68a089590a0c35b1ee/users/65bccf2b909f4fd09f6a9fa1e28b8f90/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:16.812590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.813111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.813622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.853181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.856179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.889723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] MFA Rules not processed for user `65bccf2b909f4fd09f6a9fa1e28b8f90`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:16.891642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:16.945886 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b65429-d508-4baf-a08c-de0973addd33 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:16.950765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:16.951562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:16.951846 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:16.952123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] PATH_INFO: `/v3/projects/21cb443228d1443a83f6e004181c832b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:16.953536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cb443228d1443a83f6e004181c832b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:16.955962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:16.972871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1219/2430] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:16.981119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:16.992216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe5806-c30b-45e0-b95e-1354e57756dc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.000505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.000505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.000505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.000505 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.000944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.008546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.030528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cb443228d1443a83f6e004181c832b', 'request_id': 'req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:17.047933 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cb443228d1443a83f6e004181c832b', 'request_id': 'req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:17.057588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1220/2431] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:16 2021] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:17.061512 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.072184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cb443228d1443a83f6e004181c832b', 'request_id': 'req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:17.084796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] The token cache is being invalidate because project 21cb443228d1443a83f6e004181c832b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:17.085170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:17.086076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-87cc07be-f5ff-42de-a4b4-ef9d0dce1a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:17.093140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1212/2432] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:16 2021] DELETE /identity/v3/projects/21cb443228d1443a83f6e004181c832b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:17.094701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda997-70df-487a-b030-f1162ba667e9 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.095067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda997-70df-487a-b030-f1162ba667e9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.095418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda997-70df-487a-b030-f1162ba667e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.123002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2efda997-70df-487a-b030-f1162ba667e9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:17.124667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2efda997-70df-487a-b030-f1162ba667e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.139000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2f137-285e-4bec-8153-4eaf22ce037f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.151968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.152939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.153385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.153866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.154801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.157757 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.194786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1221/2433] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:17.194786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.196029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.202798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1213/2434] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:17.207893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dac90-7080-4447-b9ee-043d565fc48b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.210494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.210795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.211096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.216213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.216928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.217287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.217642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.218412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.220130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.231219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1222/2435] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:17.233891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:17.235209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.235366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.242877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1214/2436] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:17.246090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6cc72-e1c2-4b50-9776-862c7fd7807b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.247205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.251376 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.252367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.252890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.253174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] PATH_INFO: `/v3/projects/c7515ab6939a46a2890bade9657458e9/users/c56aff244f8c4038b65f20716b15af89/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.256135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ce2a-dba2-4035-b419-0dcd67360bc4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.260741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.261342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.261634 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.261918 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.263146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:17.263146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.264540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.272968 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7515ab6939a46a2890bade9657458e9, user_id=c56aff244f8c4038b65f20716b15af89, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.275832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.277819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1215/2437] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:17.282656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.292658 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1223/2438] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:17 2021] PUT /identity/v3/projects/c7515ab6939a46a2890bade9657458e9/users/c56aff244f8c4038b65f20716b15af89/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:17.295305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31735-a885-4406-9e42-5a5bcf6e2150 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.296664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.365789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.366388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.366675 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.366954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.367591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.369622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.369784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba90a-56cc-4fab-94f3-e1c04d888ddb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.374616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.375219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.375509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.375801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.376531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.378155 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.391893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1224/2439] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:17.393110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.401998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1216/2440] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:17.405586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a56b-7931-476d-8f6c-6c7619aa0944 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.407049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.483677 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bff95-f7a4-4a03-9894-68623934f630 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.487759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.488255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.488875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.489163 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.489443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.489826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.490085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.490454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.490884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] PATH_INFO: `/v3/projects/c7515ab6939a46a2890bade9657458e9/users/c56aff244f8c4038b65f20716b15af89/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.492346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.494308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7515ab6939a46a2890bade9657458e9, user_id=c56aff244f8c4038b65f20716b15af89, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.497859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49acba-2b31-430d-bd6c-cc9f5b66513a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.512375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1225/2441] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:17 2021] PUT /identity/v3/projects/c7515ab6939a46a2890bade9657458e9/users/c56aff244f8c4038b65f20716b15af89/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:17.526214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.526558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.526906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.528348 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1217/2442] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:17.532589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.544075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581ddd7-4de1-4f41-ac36-e850f6a4166d admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.571523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] MFA Rules not processed for user `c56aff244f8c4038b65f20716b15af89`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:17.572502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.633259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.633965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.634255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.634567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.635253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.637483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.651616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1218/2443] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:17.657258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.669522 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051943-47bc-4ee9-9130-cf014997c910 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.674847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.675446 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.675725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.675996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.677065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.679310 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.680808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1226/2444] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:17.691780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1219/2445] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:17.692214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.693713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.695878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.708035 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a77dc-5a5f-4a0a-b15a-1c32d7c44479 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.712745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.713564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.713920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.714257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] PATH_INFO: `/v3/projects/f918a3fa441a43cabfa2f4a0701a60b4/users/354c5dc190ba4d1ca16c7adf26318af5/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.733776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f918a3fa441a43cabfa2f4a0701a60b4, user_id=354c5dc190ba4d1ca16c7adf26318af5, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.736685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8de1-9c21-4d9a-8c3e-8319216345cb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.752874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1220/2446] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:17 2021] PUT /identity/v3/projects/f918a3fa441a43cabfa2f4a0701a60b4/users/354c5dc190ba4d1ca16c7adf26318af5/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:17.764070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.764460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.764794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.767004 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1c8a-0e77-4b03-a74e-73915ccb377d None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.805372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] MFA Rules not processed for user `354c5dc190ba4d1ca16c7adf26318af5`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:17.806604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:17.824412 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.825008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.825358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.825599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.886172 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1221/2447] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:17.890554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:17.898384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.899976 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.909091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1227/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:17 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:17.958639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bcab2-2f9d-4cf9-aab6-a873f00c37bb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:17.963339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:17.963873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:17.964161 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:17.964485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:17.965166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:17.967037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:17.995986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1222/2449] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:18.000576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.012338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61602bd9-509f-4052-b406-5b522a7d0bdb service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.079883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.080625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.081014 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.081300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.081985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.083959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.109131 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1228/2450] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:17 2021] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:18.110226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.110386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.119966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f854-ce79-4136-a8b4-722776e93a3a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.120945 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2864fe-0e07-4897-a991-396295304a9f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.124830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.125415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.125701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.125908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.126038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.126668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.126796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.126982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.127315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] PATH_INFO: `/v3/users/65bccf2b909f4fd09f6a9fa1e28b8f90` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.128279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.128467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bccf2b909f4fd09f6a9fa1e28b8f90)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.130369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.138439 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1229/2451] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:18.142552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.152057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fed28-3fa1-4f9f-99a4-99f1335406a9 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.156740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.157718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.157832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.158086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] PATH_INFO: `/v3/projects/312e66a6b7ed4887ae6e08e919b416dc/users/5591b6aa3b4d4f279dad89af06b03d94/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.178296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312e66a6b7ed4887ae6e08e919b416dc, user_id=5591b6aa3b4d4f279dad89af06b03d94, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.181134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.185281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bccf2b909f4fd09f6a9fa1e28b8f90'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:18.194231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bccf2b909f4fd09f6a9fa1e28b8f90'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:18.195495 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1230/2452] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:18 2021] PUT /identity/v3/projects/312e66a6b7ed4887ae6e08e919b416dc/users/5591b6aa3b4d4f279dad89af06b03d94/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:18.199122 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.209575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bccf2b909f4fd09f6a9fa1e28b8f90'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:18.210334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bccf2b909f4fd09f6a9fa1e28b8f90'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:18.211153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-cacd036a-8c0b-4e14-8f70-d976a0794999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bccf2b909f4fd09f6a9fa1e28b8f90'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:18.229873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1223/2453] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:18 2021] DELETE /identity/v3/users/65bccf2b909f4fd09f6a9fa1e28b8f90 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:18.235879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.238050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.238536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.266122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:18.267296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.283904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7870c9-4cb3-4868-ad53-e0428d215b09 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.336284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1224/2454] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:18.346436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.348473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.360263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.361204 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.361456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.361801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.363056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.364559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.378786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1231/2455] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:18.382886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.385291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.397752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b97d-02e7-4d94-a59e-f87596172dbd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.402796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.403708 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.404153 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.404553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] PATH_INFO: `/v3/projects/312e66a6b7ed4887ae6e08e919b416dc/users/5591b6aa3b4d4f279dad89af06b03d94/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.406418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=312e66a6b7ed4887ae6e08e919b416dc, user_id=5591b6aa3b4d4f279dad89af06b03d94, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.409798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e2f6f-d0bf-4061-ab55-161388a75aac admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.431251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1232/2456] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:18 2021] PUT /identity/v3/projects/312e66a6b7ed4887ae6e08e919b416dc/users/5591b6aa3b4d4f279dad89af06b03d94/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:18.433833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.434125 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.434406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.446400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262d3a-9c34-4458-ae6c-671490be55d8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.472312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] MFA Rules not processed for user `5591b6aa3b4d4f279dad89af06b03d94`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:18.473449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.502505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.503088 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.503376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.503653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.548713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1233/2457] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:18 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:18.559066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.560474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.570987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.572880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.583564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1225/2458] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:18.627024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e51f72-c7f2-4c2b-822a-889cfbab4613 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.630671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.631258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.631539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.631817 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.642024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.643509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.652962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1234/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:18 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:18.764474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:18.773849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dcc2-62c3-44ef-afa8-b98b48c8204b service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:18.777305 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:18.777900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:18.778183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:18.778517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:18.780078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:18.857617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:18.859298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:18.880298 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1226/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:18 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:19.318963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:19.320563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:19.344572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba94a-0489-4108-b49f-a8a5db7f88eb service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:19.349137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:19.350103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:19.350379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:19.350769 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] PATH_INFO: `/v3/projects/5ede48bd20d84d68a089590a0c35b1ee` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:19.351986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ede48bd20d84d68a089590a0c35b1ee)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:19.354112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:19.404943 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ede48bd20d84d68a089590a0c35b1ee', 'request_id': 'req-49e58ac0-16fd-4c24-a4a5-fd38130c2737'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.413437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ede48bd20d84d68a089590a0c35b1ee', 'request_id': 'req-49e58ac0-16fd-4c24-a4a5-fd38130c2737'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.424863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ede48bd20d84d68a089590a0c35b1ee', 'request_id': 'req-49e58ac0-16fd-4c24-a4a5-fd38130c2737'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.434935 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] The token cache is being invalidate because project 5ede48bd20d84d68a089590a0c35b1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:19.435214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.435947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.438029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1235/2461] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:19 2021] DELETE /identity/v3/projects/5ede48bd20d84d68a089590a0c35b1ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:19.442207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:19.452801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e168-34ee-4b89-9d62-1d4a89ce8b1e service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:19.531786 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:19.532629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:19.532904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:19.533197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] PATH_INFO: `/v3/users/c56aff244f8c4038b65f20716b15af89` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:19.534351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56aff244f8c4038b65f20716b15af89)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:19.536260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:19.575546 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:19.577354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:19.590476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56aff244f8c4038b65f20716b15af89'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.599443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56aff244f8c4038b65f20716b15af89'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.612865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56aff244f8c4038b65f20716b15af89'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.613562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56aff244f8c4038b65f20716b15af89'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.614165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56aff244f8c4038b65f20716b15af89'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:19.628536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1227/2462] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:19 2021] DELETE /identity/v3/users/c56aff244f8c4038b65f20716b15af89 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:19.658070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58ac0-16fd-4c24-a4a5-fd38130c2737 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:19.715895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:19.716514 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:19.716804 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:19.717086 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:19.718830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:19.795278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:19.796958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c011-ac84-4719-bdb0-bdb5dd07bc94 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:19.807939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1236/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:20.038050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.039628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:20.127649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96363-2bcf-4109-a70f-d7013e764073 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.132817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.134243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.134717 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.134983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] PATH_INFO: `/v3/projects/c7515ab6939a46a2890bade9657458e9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.136171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7515ab6939a46a2890bade9657458e9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.138108 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.190319 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7515ab6939a46a2890bade9657458e9', 'request_id': 'req-0128ff60-4f23-4bd6-b432-7fe0d61889e5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:20.199228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7515ab6939a46a2890bade9657458e9', 'request_id': 'req-0128ff60-4f23-4bd6-b432-7fe0d61889e5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:20.212395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7515ab6939a46a2890bade9657458e9', 'request_id': 'req-0128ff60-4f23-4bd6-b432-7fe0d61889e5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:20.227742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] The token cache is being invalidate because project c7515ab6939a46a2890bade9657458e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:20.228025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:20.228924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-0128ff60-4f23-4bd6-b432-7fe0d61889e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:20.230535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1228/2464] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:20 2021] DELETE /identity/v3/projects/c7515ab6939a46a2890bade9657458e9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:20.235875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.236218 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.236587 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.259609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:20.260796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:20.333451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1237/2465] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:20.337103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.337398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.337858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.361193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:20.362318 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:20.370964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1229/2466] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:20.375315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.385502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c8079-1e47-4ddb-82bf-c08cbc24b274 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.390582 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.391215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.391605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.391946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.392781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:20.393144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.394824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.408531 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1238/2467] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:04:20.413562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.422771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fcdd-6c86-4e8e-9be3-416d7c82478b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.427670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.428810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.429286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.429749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.430712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.432865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.469753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1230/2468] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:20 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:20.469970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.480467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbacc-17bb-4919-a2d1-e0d10ddba73a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.545308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.545915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.546207 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.546462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.547136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.549147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.572130 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1239/2469] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:20 2021] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:20.573590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.584593 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00e8c-0988-48b8-b645-e811a2d373ce admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.589359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.589964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.590251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.590537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.591230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.592868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.603277 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1231/2470] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:20.609520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.623263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852b60-e714-4504-bc9e-f74dbaf233f3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.628816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.629478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.629807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.630128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.630920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.632992 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71704b9-699b-4f9b-8d16-b002c24cecd9 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.644316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1240/2471] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:20.648666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.659058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26c030-b0af-452a-8ebb-d495465e40b4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.664579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.666611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.667110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.667600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] PATH_INFO: `/v3/projects/99e1e8927a8a4d5bbead7844e437004a/users/2575c73fcb624bf3b3751ef22d049626/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.697766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e1e8927a8a4d5bbead7844e437004a, user_id=2575c73fcb624bf3b3751ef22d049626, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.700501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.717149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1232/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:20 2021] PUT /identity/v3/projects/99e1e8927a8a4d5bbead7844e437004a/users/2575c73fcb624bf3b3751ef22d049626/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:20.728763 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.729081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.729360 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.769646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] MFA Rules not processed for user `2575c73fcb624bf3b3751ef22d049626`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:20.770818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:20.847447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1241/2473] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:20.857955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:20.859964 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:20.926566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626884a-dfa0-40b8-b62b-144903440544 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:20.930394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:20.931001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:20.931294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:20.931575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:20.940122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:20.941538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d262-8214-4235-af49-f363d7bb7685 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:20.950408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1233/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:20 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:20.970462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:21.042642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502fd55-db38-4d99-9a9e-cffa25fb2d00 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:21.049548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:21.050381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.050668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.050945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] PATH_INFO: `/v3/users/2575c73fcb624bf3b3751ef22d049626` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.052181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2575c73fcb624bf3b3751ef22d049626)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:21.054413 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:21.107331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2575c73fcb624bf3b3751ef22d049626'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.115576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2575c73fcb624bf3b3751ef22d049626'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.128444 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2575c73fcb624bf3b3751ef22d049626'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.129176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2575c73fcb624bf3b3751ef22d049626'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.129875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2575c73fcb624bf3b3751ef22d049626'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.143258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1242/2475] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:20 2021] DELETE /identity/v3/users/2575c73fcb624bf3b3751ef22d049626 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:21.147947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.148480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.148480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.172271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:21.173627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.240854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1234/2476] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:21.251906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:21.253314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.318542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea326a-4d76-4322-99bf-61da6eb97aef admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:21.322246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:21.322825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.323114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.323406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.332686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:21.334127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:21.343832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1243/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:21.761680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:21.762909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:21.763144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.764592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.777158 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e62-b9f4-4275-afc0-d2f8f7e6747f service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:21.777373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41886da-faae-4bd5-be2f-67cdcb1bc2c9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:21.781817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:21.782637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.782931 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.783215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] PATH_INFO: `/v3/projects/99e1e8927a8a4d5bbead7844e437004a` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.784466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e1e8927a8a4d5bbead7844e437004a)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:21.784887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:21.785775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.786062 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.786350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] PATH_INFO: `/v3/users/354c5dc190ba4d1ca16c7adf26318af5` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.786465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:21.787510 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=354c5dc190ba4d1ca16c7adf26318af5)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:21.789470 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:21.845100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e1e8927a8a4d5bbead7844e437004a', 'request_id': 'req-31180506-b299-4200-901a-2423a1d84ff2'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.847473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354c5dc190ba4d1ca16c7adf26318af5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.854962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e1e8927a8a4d5bbead7844e437004a', 'request_id': 'req-31180506-b299-4200-901a-2423a1d84ff2'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.858295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354c5dc190ba4d1ca16c7adf26318af5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.866614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e1e8927a8a4d5bbead7844e437004a', 'request_id': 'req-31180506-b299-4200-901a-2423a1d84ff2'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.871422 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354c5dc190ba4d1ca16c7adf26318af5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.872555 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354c5dc190ba4d1ca16c7adf26318af5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.873283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4a67ba6c-1ff6-4254-a7e8-c3d30ec52a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354c5dc190ba4d1ca16c7adf26318af5'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.876874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] The token cache is being invalidate because project 99e1e8927a8a4d5bbead7844e437004a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:21.877153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.877772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-31180506-b299-4200-901a-2423a1d84ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:21.879234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1235/2478] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:21 2021] DELETE /identity/v3/projects/99e1e8927a8a4d5bbead7844e437004a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:21.885345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53e1e-f420-4307-a664-c13f9b71bc34 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.885888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53e1e-f420-4307-a664-c13f9b71bc34 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.886268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53e1e-f420-4307-a664-c13f9b71bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.887701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1244/2479] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:21 2021] DELETE /identity/v3/users/354c5dc190ba4d1ca16c7adf26318af5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:21.892456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.892746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.893026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.909751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-1da53e1e-f420-4307-a664-c13f9b71bc34 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:21.910951 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-1da53e1e-f420-4307-a664-c13f9b71bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.914958 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:21.916103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:21.974749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1236/2480] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:21.982575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:21.982959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:21.983289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:21.984386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1245/2481] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:21.994880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:21.996294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.006301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:22.007467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.015503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1237/2482] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:22.019716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.028486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f727b-2b33-4c12-a1c6-17e32f0fd61a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.032962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.033526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.033796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.034072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.034744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:22.035037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.036670 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.049867 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1238/2483] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:22.054299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.063926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee197d-baa3-46ee-8660-64dc92f77dbe admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.067575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd5b4-6984-4ce4-a090-2a6067c74546 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.068552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.069123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.069409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.069690 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.070338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.071135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.071713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.072000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.072229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.072366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.081533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.082993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.093152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1246/2484] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:22.100989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1239/2485] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:22 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:22.105402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.116395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b98c-d883-4c04-be9a-4def1be17d1e service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.192618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.193288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.193600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.193821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.194559 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.196731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.221715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1247/2486] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:22 2021] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:22.226149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.237818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace13fc-a261-4900-84a6-ba8faaee5493 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.243080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.244053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.244411 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.244696 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.245400 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.247435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.264576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1240/2487] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:22.265979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.278129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136f5a2-8a98-4298-a270-6a3819b04b45 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.283053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.283685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.283973 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.284285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.284980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.286592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.298655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1248/2488] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:22.303180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.328877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784721c-708e-447f-a322-b3fc62271766 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.333173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.334087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.334467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.334811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] PATH_INFO: `/v3/projects/a48448e9fef84d9aaa2946666b59573f/users/0632a24bbe7944e4abbebd46463373dc/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.336913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.357068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48448e9fef84d9aaa2946666b59573f, user_id=0632a24bbe7944e4abbebd46463373dc, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.360283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de537a-cb42-479f-acb1-e02fa5705823 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.376755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1241/2489] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:22 2021] PUT /identity/v3/projects/a48448e9fef84d9aaa2946666b59573f/users/0632a24bbe7944e4abbebd46463373dc/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:22.388058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.388629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.389080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.406469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6814aa-a84d-421f-8659-ed505097afb8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.425416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] MFA Rules not processed for user `0632a24bbe7944e4abbebd46463373dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:22.426420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.473818 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.474549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.474866 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.475341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.477186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.511029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1242/2490] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:22 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:22.513202 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.521243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.589323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.591041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.594891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19389fc-5497-4c8a-8452-7adf9be2f399 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.602454 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.603596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.604104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.604612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] PATH_INFO: `/v3/projects/f918a3fa441a43cabfa2f4a0701a60b4` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.606124 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f918a3fa441a43cabfa2f4a0701a60b4)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.606863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1249/2491] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:22.608073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.610977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.623565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.683340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6cbe5-7a74-4ef2-bcfb-213c2751fac8 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.699901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.700595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.700886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.701170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.711383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.713044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.723558 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1250/2492] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:22 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:22.734006 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f918a3fa441a43cabfa2f4a0701a60b4', 'request_id': 'req-c64264cb-7e34-422a-ada3-92d8e4f9a627'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.746121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f918a3fa441a43cabfa2f4a0701a60b4', 'request_id': 'req-c64264cb-7e34-422a-ada3-92d8e4f9a627'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.759712 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f918a3fa441a43cabfa2f4a0701a60b4', 'request_id': 'req-c64264cb-7e34-422a-ada3-92d8e4f9a627'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.762363 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.777898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] The token cache is being invalidate because project f918a3fa441a43cabfa2f4a0701a60b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:22.778324 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.778640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6fc1c-b932-4a82-89e8-5f5f6c7ddc68 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.779191 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.780828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1243/2493] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:22 2021] DELETE /identity/v3/projects/f918a3fa441a43cabfa2f4a0701a60b4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:22.792024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:22.793715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:22.882611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.883876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.883876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.884377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] PATH_INFO: `/v3/users/0632a24bbe7944e4abbebd46463373dc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.885609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0632a24bbe7944e4abbebd46463373dc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.887615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.935903 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64264cb-7e34-422a-ada3-92d8e4f9a627 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:22.942067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:22.943003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:22.943364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:22.943714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] PATH_INFO: `/v3/users/5591b6aa3b4d4f279dad89af06b03d94` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:22.945014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5591b6aa3b4d4f279dad89af06b03d94)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:22.946436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0632a24bbe7944e4abbebd46463373dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.947484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:22.955480 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0632a24bbe7944e4abbebd46463373dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.975041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0632a24bbe7944e4abbebd46463373dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.976600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0632a24bbe7944e4abbebd46463373dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:22.977856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fee3dce1-592b-499e-8798-63edc4b28b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0632a24bbe7944e4abbebd46463373dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.003340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1251/2494] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:22 2021] DELETE /identity/v3/users/0632a24bbe7944e4abbebd46463373dc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:23.007808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:23.016520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:23.017018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:23.018045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5591b6aa3b4d4f279dad89af06b03d94'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.030359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5591b6aa3b4d4f279dad89af06b03d94'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.044896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:23.046059 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:23.047248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5591b6aa3b4d4f279dad89af06b03d94'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.049082 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5591b6aa3b4d4f279dad89af06b03d94'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.050852 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5591b6aa3b4d4f279dad89af06b03d94'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.069961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1244/2495] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:22 2021] DELETE /identity/v3/users/5591b6aa3b4d4f279dad89af06b03d94 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:23.147377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1252/2496] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:23.160193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:23.162111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:23.255097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c62b35-f4cc-4c3e-8c9d-0b28f3cbca4c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:23.258828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:23.259491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:23.259830 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:23.260114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:23.341767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:23.343993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892d2b1-df76-4987-8572-142ba973cada service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:23.358369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1245/2497] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:23.836041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:23.837621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:23.855594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c266f-d3ed-450a-b7a4-e7ddd9ca3079 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:23.872537 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:23.873385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:23.873783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:23.873949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] PATH_INFO: `/v3/projects/312e66a6b7ed4887ae6e08e919b416dc` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:23.882602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=312e66a6b7ed4887ae6e08e919b416dc)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:23.885008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:23.980949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312e66a6b7ed4887ae6e08e919b416dc', 'request_id': 'req-ca86e144-5633-478a-9c86-155e3be094dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:23.989795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312e66a6b7ed4887ae6e08e919b416dc', 'request_id': 'req-ca86e144-5633-478a-9c86-155e3be094dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.003637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312e66a6b7ed4887ae6e08e919b416dc', 'request_id': 'req-ca86e144-5633-478a-9c86-155e3be094dc'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.015305 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] The token cache is being invalidate because project 312e66a6b7ed4887ae6e08e919b416dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:24.015692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.016693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca86e144-5633-478a-9c86-155e3be094dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.018845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1253/2498] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:23 2021] DELETE /identity/v3/projects/312e66a6b7ed4887ae6e08e919b416dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:24.024962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e38c8-1c35-4464-8694-801f5c002c0d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.025249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e38c8-1c35-4464-8694-801f5c002c0d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.025541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e38c8-1c35-4464-8694-801f5c002c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.056557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-739e38c8-1c35-4464-8694-801f5c002c0d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.058357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-739e38c8-1c35-4464-8694-801f5c002c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.156658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:24.162001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a50b-02a4-47e8-b331-b968a581568e None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.162903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a50b-02a4-47e8-b331-b968a581568e None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.163345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a50b-02a4-47e8-b331-b968a581568e None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.164033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.164440 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.164827 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.165855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1254/2500] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 13:04:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 13:04:24.171861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae0c0c-ee60-4fb9-b212-6883eabcfe51 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.172445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae0c0c-ee60-4fb9-b212-6883eabcfe51 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.173259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae0c0c-ee60-4fb9-b212-6883eabcfe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.192771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.194620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.206329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1247/2501] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:24.207721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.209602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.226000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f53667-081f-4612-8b91-432c432188b0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.231673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.232912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.233489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.233835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] PATH_INFO: `/v3/projects/a48448e9fef84d9aaa2946666b59573f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.235201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48448e9fef84d9aaa2946666b59573f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.237252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.289586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-61ae0c0c-ee60-4fb9-b212-6883eabcfe51 None None] MFA Rules not processed for user `7ec290df16034659ad193a9b20f7507e`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.290855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-61ae0c0c-ee60-4fb9-b212-6883eabcfe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.299085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48448e9fef84d9aaa2946666b59573f', 'request_id': 'req-73c7a88b-bc2f-47a8-a780-13775cc49acb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.310188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48448e9fef84d9aaa2946666b59573f', 'request_id': 'req-73c7a88b-bc2f-47a8-a780-13775cc49acb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.322860 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48448e9fef84d9aaa2946666b59573f', 'request_id': 'req-73c7a88b-bc2f-47a8-a780-13775cc49acb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.333831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] The token cache is being invalidate because project a48448e9fef84d9aaa2946666b59573f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:24.334270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.335028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:24.337226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1248/2502] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:24 2021] DELETE /identity/v3/projects/a48448e9fef84d9aaa2946666b59573f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:24.337993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.339493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.402448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1255/2503] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:24.408892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.408892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.408892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.422728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a88b-bc2f-47a8-a780-13775cc49acb admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.427303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.427990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.428408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.428780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.429555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:24.429961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.431834 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.433646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.434991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.442821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1256/2504] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:24.445301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1249/2505] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:04:24.445801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.447361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.449552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.459913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06568ae9-3386-447b-a27d-074b75bd0c77 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.464825 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.465768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.466157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.466533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.467676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.470302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befce59-48e5-48bf-9342-2d81a736ec2a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.500443 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1250/2506] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:24.502041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.502408 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.502842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.521214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578879-a579-4e89-95fc-264615e43f5b None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.532026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.533295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.585414 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.586013 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.586299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.586612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.611778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1251/2507] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:24.613961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.625102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16bfd-73dc-40a6-a42c-9d953f4bb57c None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.630455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.631062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.631375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.631667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.633627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.634453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.657385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1252/2508] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:24.658552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.668741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637f8f-5f01-4c7d-9dbb-36a55003eca2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.673106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.673684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.673924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.674041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.674223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.674928 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:24.675225 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.675929 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.676889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.687034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1257/2509] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:24.688752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.694351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1253/2510] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:04:24.698823 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.706523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eac6b-9ded-43a0-b9e7-00fd9305d5eb service glance] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.709919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950e8a1-15e1-4dab-9844-c13023ab0b07 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.713443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.714294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.714672 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.715025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.715864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.716749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.717343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.717636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.717946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.718267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.718584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.721113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.734832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1258/2511] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:24.739280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.759497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1254/2512] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:24.760420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea008b0-00ce-44e1-b250-ccb5075a7b9c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.764580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.852094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14f13a-b70e-4cba-b207-178495d6d797 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.856962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.857740 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.858109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.858476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.859218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.861503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.885910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.886477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.886758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.887034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.887795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.889443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557478c8-3716-498c-a9aa-3a519dda1386 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.903836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1259/2513] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:24.903836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061802af-0169-419a-9290-cb97c8845538 None None] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.903836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061802af-0169-419a-9290-cb97c8845538 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.903836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061802af-0169-419a-9290-cb97c8845538 None None] PATH_INFO: `/` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.904699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1260/2514] 10.222.0.60 () {54 vars in 921 bytes} [Tue Nov 23 13:04:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 13:04:24.906189 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1255/2515] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:24.906329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061802af-0169-419a-9290-cb97c8845538 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.907272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:24.920736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061802af-0169-419a-9290-cb97c8845538 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.925525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.926135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.926562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.926852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.927577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.929421 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5170c01-042f-4795-a06d-71064c3d1c55 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.932954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ecdc1-e69e-4f68-8daa-184272d8a1bf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:24.939380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:24.940490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.940986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.944151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1261/2516] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:24.944151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727ce2-0134-4136-8468-dde6b6e7e004 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:24.944151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727ce2-0134-4136-8468-dde6b6e7e004 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:24.944151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99727ce2-0134-4136-8468-dde6b6e7e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.945065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] PATH_INFO: `/v3/projects/8c22cf62f5d24845bcc6cb6406acf177/users/2d9f9fd7e074437eb3f24b2a007221a9/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:24.969736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-99727ce2-0134-4136-8468-dde6b6e7e004 None None] MFA Rules not processed for user `326b9ed23f5a43d6bb57a386c688c873`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:24.971052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-99727ce2-0134-4136-8468-dde6b6e7e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:24.974648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c22cf62f5d24845bcc6cb6406acf177, user_id=2d9f9fd7e074437eb3f24b2a007221a9, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:24.979201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:24.998216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1256/2517] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:24 2021] PUT /identity/v3/projects/8c22cf62f5d24845bcc6cb6406acf177/users/2d9f9fd7e074437eb3f24b2a007221a9/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:24.999195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.050792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1262/2518] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Nov 23 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:25.052214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.052598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.053012 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.097338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] MFA Rules not processed for user `2d9f9fd7e074437eb3f24b2a007221a9`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:25.097585 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db51d-8c31-4393-a84e-aaaf7359196f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.098520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:25.102612 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.103249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.103839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.103839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.104572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.106590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.120987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1257/2519] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:25.122808 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.126106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:25.181549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1263/2520] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:25.182575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.193446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe28e-6faf-40ea-9a65-5c8d6a64b271 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.197543 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fa106-8a38-4d71-b230-b58a9623ba72 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.199616 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.200269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.200552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.200832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] PATH_INFO: `/v3/projects/a9754470c11c42fe939332f9cd64c013/users/a5195852f57e4f5ca36bf8b2336b21b1/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.201720 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.202376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.202742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.203113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.210983 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.212649 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.220776 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1258/2521] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:25 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:25.221546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.224017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9754470c11c42fe939332f9cd64c013, user_id=a5195852f57e4f5ca36bf8b2336b21b1, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.227053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb759-6024-4973-b8f9-4f3ce73cfe2c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.233896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9467-5ff6-48e6-8aea-4ca2e462ce50 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.238742 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.239641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.239761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.240040 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.240715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.242671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.244324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1264/2522] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:25 2021] PUT /identity/v3/projects/a9754470c11c42fe939332f9cd64c013/users/a5195852f57e4f5ca36bf8b2336b21b1/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:25.255659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.255911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.256389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.279132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1259/2523] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:25 2021] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:25.283003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.311129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] MFA Rules not processed for user `a5195852f57e4f5ca36bf8b2336b21b1`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:25.313094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:25.357272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3801d-1892-484d-9cea-eadbf9d7d3a6 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.362580 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.363248 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.363621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.364001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.364793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.366978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.393552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1260/2524] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:25 2021] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:25.398624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.409968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c5ad-d610-469b-8a40-6d738cd31562 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.415231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.415913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.416399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.416736 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.417554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.419530 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.430405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1265/2525] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:25.431819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1261/2526] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:25.444212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.448004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.474497 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce8d9-7c48-4c2d-a189-5ed96dc34c03 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.480229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.482166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.482611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.483043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] PATH_INFO: `/v3/projects/97291bd675c74ac1b834755f99ed0e75/users/fba41523c2d049f4982f5040969fef4c/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.509367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97291bd675c74ac1b834755f99ed0e75, user_id=fba41523c2d049f4982f5040969fef4c, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.515256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.541399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1266/2527] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:25 2021] PUT /identity/v3/projects/97291bd675c74ac1b834755f99ed0e75/users/fba41523c2d049f4982f5040969fef4c/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:25.545178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.548398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b740b2-67d2-42a1-ae92-80282f6054a2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.638705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80cc9-53ce-4caa-8517-23607d00088f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.640291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.641122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.641652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.642313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.643795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.644481 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.644963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.645343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.646310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.647980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.664081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1267/2528] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:25.669795 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.684755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4fb01-c0b4-4d41-8ce5-bbc910163142 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:25.690151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:25.691170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.691550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.692220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] PATH_INFO: `/v3/projects/97291bd675c74ac1b834755f99ed0e75/users/fba41523c2d049f4982f5040969fef4c/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.694913 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97291bd675c74ac1b834755f99ed0e75, user_id=fba41523c2d049f4982f5040969fef4c, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.698888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433aa72-6795-46bd-ac65-99093e8674d7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.714242 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1268/2529] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:25 2021] PUT /identity/v3/projects/97291bd675c74ac1b834755f99ed0e75/users/fba41523c2d049f4982f5040969fef4c/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:25.725043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:25.725354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:25.725738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:25.726138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:25.730627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:25.750459 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1262/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:25 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:25.773553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] MFA Rules not processed for user `fba41523c2d049f4982f5040969fef4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:25.775826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:25.880644 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1269/2531] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:25.890851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:25.892473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:26.017526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb50b2-7e91-4028-b91a-164e453d1173 service glance] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:26.116442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:26.117094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:26.117393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:26.117706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:26.133293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:26.135605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:26.155691 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1263/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:25 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:27.548566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:27.566408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705ea3-5811-458e-a0a7-4fd0ec0d5b98 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:27.570405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:27.571051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:27.571327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:27.571621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:27.574038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:27.649286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:27.650952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ceeac-33dd-400a-925a-47543dba4710 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:27.662060 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1270/2533] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:27 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:28.403455 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:28.501074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c6b9-50bb-41fe-b8a5-93ec8ca2adce service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:28.510526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:28.511391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:28.511678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:28.511965 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] PATH_INFO: `/v3/users/2d9f9fd7e074437eb3f24b2a007221a9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:28.513185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9f9fd7e074437eb3f24b2a007221a9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:28.515118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:28.626419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9f9fd7e074437eb3f24b2a007221a9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:28.643795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9f9fd7e074437eb3f24b2a007221a9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:28.661278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9f9fd7e074437eb3f24b2a007221a9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:28.662079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9f9fd7e074437eb3f24b2a007221a9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:28.662694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9f9fd7e074437eb3f24b2a007221a9'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:28.682017 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1264/2534] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:28 2021] DELETE /identity/v3/users/2d9f9fd7e074437eb3f24b2a007221a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:28.686844 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:28.687430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:28.687525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:28.717490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:28.718985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:28.802883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1271/2535] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:28.815850 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:28.817513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:28.935727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a115-dbd9-4295-aa04-1a1c96c00078 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:28.947412 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:28.948551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:28.948705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:28.948961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:28.960523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:28.961891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc610e-890b-4588-8980-9273c4b69756 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:28.973029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1265/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:04:29.297974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:29.299590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.311135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1708bb-0c26-4700-8be4-c491114839be None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:29.323345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:29.324979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:29.325191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:29.325625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] PATH_INFO: `/v3/users/55c33ad2d09c495983a8a8c17089e351` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:29.327572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c33ad2d09c495983a8a8c17089e351)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:29.329623 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:29.379975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c33ad2d09c495983a8a8c17089e351'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.389442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c33ad2d09c495983a8a8c17089e351'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.404296 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c33ad2d09c495983a8a8c17089e351'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.405039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c33ad2d09c495983a8a8c17089e351'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.405635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c33ad2d09c495983a8a8c17089e351'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.420633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1272/2537] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:29 2021] DELETE /identity/v3/users/55c33ad2d09c495983a8a8c17089e351 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:29.425376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:29.426294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:29.426743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:29.450889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:29.452309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.504882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:29.507502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.594892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1266/2538] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:29.597979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67595e7-de68-4a29-9807-44070b6a4650 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:29.599535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:29.601213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.603776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:29.604695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:29.605052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:29.605401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] PATH_INFO: `/v3/projects/8c22cf62f5d24845bcc6cb6406acf177` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:29.606586 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c22cf62f5d24845bcc6cb6406acf177)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:29.608630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:29.687567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ad704-0783-4c0d-8aac-82ea98bdedd4 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:29.696955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c22cf62f5d24845bcc6cb6406acf177', 'request_id': 'req-d4dab077-aff1-4c18-aef9-f5e03529df52'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.708552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c22cf62f5d24845bcc6cb6406acf177', 'request_id': 'req-d4dab077-aff1-4c18-aef9-f5e03529df52'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.724614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c22cf62f5d24845bcc6cb6406acf177', 'request_id': 'req-d4dab077-aff1-4c18-aef9-f5e03529df52'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.737553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] The token cache is being invalidate because project 8c22cf62f5d24845bcc6cb6406acf177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:29.737919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.738715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:29.740912 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1273/2539] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:29 2021] DELETE /identity/v3/projects/8c22cf62f5d24845bcc6cb6406acf177 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:29.748258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:29.749660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.764988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:29.765664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:29.766023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:29.766367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:29.769388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:29.864078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dab077-aff1-4c18-aef9-f5e03529df52 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:29.869143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:29.870469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:29.870759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:29.871210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] PATH_INFO: `/v3/users/fba41523c2d049f4982f5040969fef4c` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:29.873042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba41523c2d049f4982f5040969fef4c)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:29.875490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:29.893638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:29.894900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64639b22-03a3-4956-836a-8ad14f3adf28 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:29.917800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1267/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:30.019128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba41523c2d049f4982f5040969fef4c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.041366 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba41523c2d049f4982f5040969fef4c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.052293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:30.052953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:30.053416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:30.086946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba41523c2d049f4982f5040969fef4c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.092049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba41523c2d049f4982f5040969fef4c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.094633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba41523c2d049f4982f5040969fef4c'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.104072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:30.105512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:30.122890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1274/2541] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:04:29 2021] DELETE /identity/v3/users/fba41523c2d049f4982f5040969fef4c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:30.211960 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1268/2542] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Nov 23 13:04:30 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:30.226693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:30.228361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:30.331209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0825-16cf-4334-98be-e0dab1da8d2e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:30.338384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:30.339388 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:30.339713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:30.341482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:30.411048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:30.412842 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:30.421396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1275/2543] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:04:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:04:30.504848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:30.507889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:30.535100 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257263a-26e4-4df2-8327-f5795a3dbcf3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:30.628988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:30.629809 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:30.630164 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:30.630507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] PATH_INFO: `/v3/projects/682b61854a484b10b65c9fcc50e2923c` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:30.631826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=682b61854a484b10b65c9fcc50e2923c)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:30.635639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:30.731600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682b61854a484b10b65c9fcc50e2923c', 'request_id': 'req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.764870 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682b61854a484b10b65c9fcc50e2923c', 'request_id': 'req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.766900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:30.768944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:30.784062 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682b61854a484b10b65c9fcc50e2923c', 'request_id': 'req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.800383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] The token cache is being invalidate because project 682b61854a484b10b65c9fcc50e2923c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:30.801067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.801521 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce05e0-e871-45b2-959a-02ede6742b13 service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:30.802542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2fa55eb9-afc0-4e4d-83aa-96d0c3b94bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:30.804807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1269/2544] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:30 2021] DELETE /identity/v3/projects/682b61854a484b10b65c9fcc50e2923c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:30.818610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff026b-31df-4507-8b63-1a43a12704a6 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:30.819486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff026b-31df-4507-8b63-1a43a12704a6 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:30.820120 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff026b-31df-4507-8b63-1a43a12704a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:30.870753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4eff026b-31df-4507-8b63-1a43a12704a6 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:30.875232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4eff026b-31df-4507-8b63-1a43a12704a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:30.938318 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:30.942165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:30.942659 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:30.943092 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] PATH_INFO: `/v3/projects/97291bd675c74ac1b834755f99ed0e75` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:30.944908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97291bd675c74ac1b834755f99ed0e75)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:30.951193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.019907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1270/2545] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:31.029121 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.029572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.029978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.074564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:31.075856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:31.087881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97291bd675c74ac1b834755f99ed0e75', 'request_id': 'req-e00d8d73-bd49-485f-a77e-ee833e30d4a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:31.107053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97291bd675c74ac1b834755f99ed0e75', 'request_id': 'req-e00d8d73-bd49-485f-a77e-ee833e30d4a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:31.140129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97291bd675c74ac1b834755f99ed0e75', 'request_id': 'req-e00d8d73-bd49-485f-a77e-ee833e30d4a4'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:31.162458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] The token cache is being invalidate because project 97291bd675c74ac1b834755f99ed0e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:04:31.162796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:31.164598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e00d8d73-bd49-485f-a77e-ee833e30d4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:04:31.180807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1276/2546] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:04:30 2021] DELETE /identity/v3/projects/97291bd675c74ac1b834755f99ed0e75 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:04:31.191007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffeaa-431d-41db-8f7b-9679f001e6fb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.191231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffeaa-431d-41db-8f7b-9679f001e6fb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.191499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffeaa-431d-41db-8f7b-9679f001e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.235723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-83dffeaa-431d-41db-8f7b-9679f001e6fb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:31.236967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-83dffeaa-431d-41db-8f7b-9679f001e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:31.318169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1271/2547] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:31.325069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.345806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783e85b-1e57-4b0a-8099-ece59126a1f1 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.358159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.359614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.360036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.360448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.361620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:31.362016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.364218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.394537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1272/2548] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:31.403771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.421883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662933-4f4d-496d-b0e6-575fdfea6308 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.438810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1277/2549] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:31.443148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.443702 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.443977 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.444275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.444920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.446946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.448310 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.448601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.464703 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.490786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:31.492790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:31.507639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1278/2550] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:04:31.512494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.523967 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872cf58-2164-4b7b-9f37-3bdf9039c534 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.537289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.537905 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.538189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.538540 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.540018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:04:31.540343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.544645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1273/2551] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:31.548818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.549135 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.581350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1279/2552] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:04:31.584776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.606552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a096a84-f275-42b4-abe9-a6941fd9e864 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.681682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af5c28-eb41-46f2-b84c-1c68c7786541 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.686864 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.687491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.687994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.688313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.688982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.690980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.733482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1274/2553] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:31.737483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.756537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8993e5-9caa-4827-80e4-3c12ffaa0939 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.781992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.782621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.783043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.783423 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.784231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.788863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.811515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1275/2554] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:31.816074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.818557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.819949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.820618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.821173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.822248 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.824678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.846958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19cff9-114a-4880-9ee7-f6d956342b6c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.861564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:31.862219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:31.862453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:31.862924 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:31.865263 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:31.867212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1280/2555] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/projects => generated 367 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:04:31.871332 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.885814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:31.908647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1276/2556] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:31.912335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:31.923523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf829-46ab-4a5c-911b-5c425b71262c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:31.988709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7203db-8de5-406a-af06-cb09dd63f81c admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:32.002910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.003555 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.003845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.004134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.004814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.006762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.043010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.044008 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.053284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.053284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] PATH_INFO: `/v3/projects/64ccb3cb04044c1a8d9adce2513ce550/users/a5d644f241ed4947bb938c2e7acfdd53/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.053743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1281/2557] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:04:31 2021] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:04:32.054859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:32.069432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1e2c8-2539-4c7d-8e31-866d2be8cadc admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:32.074890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.075506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.075808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.076292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.077047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.079269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.082094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ccb3cb04044c1a8d9adce2513ce550, user_id=a5d644f241ed4947bb938c2e7acfdd53, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.090400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1282/2558] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:32 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:04:32.093701 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3a02e-f126-484a-9faa-c45ac4eb3dcf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.094595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:32.105696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68290c-1484-4b5b-9f1c-cd1a88e29727 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:32.112102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1277/2559] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:31 2021] PUT /identity/v3/projects/64ccb3cb04044c1a8d9adce2513ce550/users/a5d644f241ed4947bb938c2e7acfdd53/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:32.123036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.123331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.123613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.167904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] MFA Rules not processed for user `a5d644f241ed4947bb938c2e7acfdd53`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:32.169206 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:32.184921 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.185979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.186426 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.186876 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.187952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.189888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.202101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1283/2560] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:04:32 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:04:32.208511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:32.221855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c55a8f-b7b2-4325-a6c4-9568e732e539 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:32.227904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.228860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.229149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.229419 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] PATH_INFO: `/v3/projects/27563d15a96d4725b454d3affe91039b/users/195a7a0b9bc946e8b24a6297b9f9c268/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.250966 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27563d15a96d4725b454d3affe91039b, user_id=195a7a0b9bc946e8b24a6297b9f9c268, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.253748 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c0104-8d4d-466b-8cec-0ee7e874cfc7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.263796 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1278/2561] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:32 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:32.275264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:32.277602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:32.280599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1284/2562] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:04:32 2021] PUT /identity/v3/projects/27563d15a96d4725b454d3affe91039b/users/195a7a0b9bc946e8b24a6297b9f9c268/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:04:32.293970 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.294302 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.294583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.341635 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] MFA Rules not processed for user `195a7a0b9bc946e8b24a6297b9f9c268`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:04:32.343048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:32.361820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972a30b-d4a0-4f82-82c3-65007ec6495d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:32.436785 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:32.437388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:32.437689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:32.438104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:32.446575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1285/2563] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:04:32 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:04:32.515086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:32.516651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:32.526526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1279/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:32 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:04:41.741165 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:04:41.743434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:04:41.817709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1168c-b7a6-4b24-9a14-24109bf5fa0c None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:04:41.821747 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:04:41.822343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:04:41.822826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:04:41.823113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:04:41.832742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:04:41.834191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:04:41.843400 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1286/2565] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:04:41 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:08.811357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:08.813492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:08.879053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009496-9df5-4f90-8826-c922db193716 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:08.883176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:08.883752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:08.884044 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:08.884364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:08.886093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:08.954879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:08.956192 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:08.966000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1280/2566] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:08 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:09.688855 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:09.690771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:09.780255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339b9b-69db-47b9-aa5c-c4469a5acece service glance] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:09.786312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:09.786910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:09.787195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:09.787483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:09.789224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:09.801754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:09.803361 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:09.814395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1287/2567] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:09 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:10.593439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:10.594848 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:10.606472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa5a8a-5d91-48ac-b19d-690fc7438396 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:10.610366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:10.610969 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:10.611260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:10.611538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:10.613352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:10.628523 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:10.630361 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639aef6-da91-4dc1-8bd8-0924e39c2b7c service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:10.639068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1281/2568] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:10 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:11.648719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:11.650843 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:11.666675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b313-1e2a-48c5-b278-a97a9c2aaaf0 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:11.673320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:11.674372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:11.674674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:11.675080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:11.678642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:11.692468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:11.694690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:11.708424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1288/2569] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:11 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:13.554632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:13.555149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:13.555255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:13.584632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:13.585790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:13.654435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1282/2570] 10.222.0.60 () {58 vars in 967 bytes} [Tue Nov 23 13:05:13 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:13.677266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:13.678694 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:13.755839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f0787-5ccc-4901-8f5c-d720868e93b6 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:13.760553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:13.761143 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:13.761427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:13.761704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:13.770682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:13.772322 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b1699-0b84-4be8-b9d1-90096712107a service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:13.782056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1289/2571] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:05:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 13:05:14.185323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:14.287581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4850-1752-47ab-986c-6422c811e5ea None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:14.301531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:14.302532 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:14.302920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:14.303291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] PATH_INFO: `/v3/users/a5d644f241ed4947bb938c2e7acfdd53` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:14.306111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d644f241ed4947bb938c2e7acfdd53)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:14.308204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:14.386847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d644f241ed4947bb938c2e7acfdd53'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:14.398144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d644f241ed4947bb938c2e7acfdd53'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:14.414884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d644f241ed4947bb938c2e7acfdd53'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:14.415793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d644f241ed4947bb938c2e7acfdd53'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:14.416754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d644f241ed4947bb938c2e7acfdd53'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:14.438617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1283/2572] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:05:14 2021] DELETE /identity/v3/users/a5d644f241ed4947bb938c2e7acfdd53 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:14.443682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:14.444260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:14.444566 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:14.469909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:14.471100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:14.547317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1290/2573] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:05:14.558183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:14.560133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:14.646605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1511ca-d6b4-42f2-a975-f5ed12f34313 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:14.650341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:14.650996 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:14.651291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:14.651576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:14.669722 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:14.671710 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:14.689550 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1284/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:15.380208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:15.381695 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:15.401095 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e949bf-3870-47ab-b819-abcbc0a28f80 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:15.405978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:15.406592 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:15.406939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:15.407290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] PATH_INFO: `/v3/projects/64ccb3cb04044c1a8d9adce2513ce550` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:15.409146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ccb3cb04044c1a8d9adce2513ce550)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:15.411197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:15.476782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ccb3cb04044c1a8d9adce2513ce550', 'request_id': 'req-43ebf968-d750-44fa-b91e-da46c1488a3f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:15.485572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ccb3cb04044c1a8d9adce2513ce550', 'request_id': 'req-43ebf968-d750-44fa-b91e-da46c1488a3f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:15.498099 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ccb3cb04044c1a8d9adce2513ce550', 'request_id': 'req-43ebf968-d750-44fa-b91e-da46c1488a3f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:15.509707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] The token cache is being invalidate because project 64ccb3cb04044c1a8d9adce2513ce550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:05:15.510056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:15.511189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-43ebf968-d750-44fa-b91e-da46c1488a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:15.512707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1291/2575] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:05:15 2021] DELETE /identity/v3/projects/64ccb3cb04044c1a8d9adce2513ce550 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:33.561884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:33.563513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:33.576962 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7e29-3414-4603-a5c5-63d04779b2d9 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:33.640468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:33.641264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:33.641546 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:33.641822 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] PATH_INFO: `/v3/users/a5195852f57e4f5ca36bf8b2336b21b1` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:33.642915 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5195852f57e4f5ca36bf8b2336b21b1)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:33.644861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:33.700093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5195852f57e4f5ca36bf8b2336b21b1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:33.709293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5195852f57e4f5ca36bf8b2336b21b1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:33.725273 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5195852f57e4f5ca36bf8b2336b21b1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:33.726339 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5195852f57e4f5ca36bf8b2336b21b1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:33.727299 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5195852f57e4f5ca36bf8b2336b21b1'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:33.747002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1285/2576] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:05:33 2021] DELETE /identity/v3/users/a5195852f57e4f5ca36bf8b2336b21b1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:33.752961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:33.753740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:33.753740 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:33.776793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:33.777946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:33.846682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1292/2577] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:33.857369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:33.859130 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:33.932313 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b790-4574-486f-98dd-aef889a3ccf7 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:33.936510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:33.937095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:33.937382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:33.937662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:33.947676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:33.949142 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e8d7e-d6ef-45bb-b30f-66d070d95457 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:33.958510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1286/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:05:34.339374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.340983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:34.352739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775377-93f5-459a-8ce8-c1a354e0d789 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.357738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.358572 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.358867 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.359154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] PATH_INFO: `/v3/projects/a9754470c11c42fe939332f9cd64c013` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.360338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9754470c11c42fe939332f9cd64c013)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.362258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.412840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9754470c11c42fe939332f9cd64c013', 'request_id': 'req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:34.423330 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9754470c11c42fe939332f9cd64c013', 'request_id': 'req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:34.435076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9754470c11c42fe939332f9cd64c013', 'request_id': 'req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:34.445919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] The token cache is being invalidate because project a9754470c11c42fe939332f9cd64c013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:05:34.446199 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:34.446873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-b01ca9ac-59be-4ee1-bfe5-d1c1fac4ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:34.448789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1293/2579] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:05:34 2021] DELETE /identity/v3/projects/a9754470c11c42fe939332f9cd64c013 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:34.454667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222790-60c2-458c-827a-a99f47c92024 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.454972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222790-60c2-458c-827a-a99f47c92024 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.455231 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da222790-60c2-458c-827a-a99f47c92024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.479328 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-da222790-60c2-458c-827a-a99f47c92024 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:34.480602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-da222790-60c2-458c-827a-a99f47c92024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:34.552604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1287/2580] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:34.564625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.565119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.565386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.593793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:34.594994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:34.603390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1294/2581] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:34.608168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da222790-60c2-458c-827a-a99f47c92024 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.621979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da222790-60c2-458c-827a-a99f47c92024 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.633477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.634259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.634352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.634682 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.635537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:05:34.635839 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.637468 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.651016 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1288/2582] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:05:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:05:34.655787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.664657 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883316f2-d2a7-4f8e-9749-a23393922741 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.669338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.669925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.670208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.670490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.671129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.673061 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.704040 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1295/2583] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:05:34 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:05:34.705573 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.715379 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e04d-fa09-4d4e-9473-f276c8a6778a admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.788357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.788986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.789265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.789551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.790201 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.792350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.815364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1289/2584] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:05:34 2021] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:05:34.819589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.831265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699f7a-1423-42a6-8ea4-b22f4bc1ccd8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.836465 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.837185 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.837538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.837887 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.838934 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.840686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.851483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1296/2585] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:34.856198 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.866158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49394b31-547b-4026-b8af-07009cc45bc2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.872501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.873179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.873460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.873737 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.874435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.876025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b280a-9e55-479d-8f8c-32beec677d82 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.886413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1290/2586] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:34.890762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:34.900410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529082c9-3ed1-4db7-8438-f7caea00b611 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:34.905064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:34.905938 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.906227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.906511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] PATH_INFO: `/v3/projects/90112b6f3d31421a8ee18cbe7d6b0537/users/6eb8e090f8ae4a2381c9b82a8090f112/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.930355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=90112b6f3d31421a8ee18cbe7d6b0537, user_id=6eb8e090f8ae4a2381c9b82a8090f112, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:34.934075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:34.953034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1297/2587] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:05:34 2021] PUT /identity/v3/projects/90112b6f3d31421a8ee18cbe7d6b0537/users/6eb8e090f8ae4a2381c9b82a8090f112/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:34.958500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b303-3670-40b8-8249-bcee47664b48 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:34.958795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b303-3670-40b8-8249-bcee47664b48 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:34.959049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378b303-3670-40b8-8249-bcee47664b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:34.986806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6378b303-3670-40b8-8249-bcee47664b48 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:34.988568 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6378b303-3670-40b8-8249-bcee47664b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:35.062775 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1291/2588] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:05:35.075436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:35.078584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:35.149532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed31e-4599-4b20-8b65-a95ee0af50ce admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:35.154098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:35.154673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:35.154965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:35.155240 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:35.164875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:35.166391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:35.175630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1298/2589] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:36.063402 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb3-4f8f-4270-8b43-425fdc853d39 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:36.064340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb3-4f8f-4270-8b43-425fdc853d39 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:36.064630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb3-4f8f-4270-8b43-425fdc853d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:36.100547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-6d390eb3-4f8f-4270-8b43-425fdc853d39 None None] MFA Rules not processed for user `6eb8e090f8ae4a2381c9b82a8090f112`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:36.101726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6d390eb3-4f8f-4270-8b43-425fdc853d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:36.181570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1292/2590] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:36 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:36.192892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:36.195396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:36.292693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfaf3b-3155-4bb5-858c-54f831249ffa service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:36.296272 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:36.297036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:36.297327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:36.297774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:36.306979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:36.309196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:36.319542 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1299/2591] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:36 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:37.849444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:37.850014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:37.850014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:37.875395 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] MFA Rules not processed for user `6eb8e090f8ae4a2381c9b82a8090f112`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:37.876594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:37.883050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1293/2592] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:37 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:38.201235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:38.202856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.215904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cddc8-c8f4-4d58-8388-ad5adf9fa01c service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:38.220031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:38.220646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:38.220931 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:38.221209 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:38.223274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.234349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:38.235812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:38.244048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1300/2593] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:38 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:05:38.657988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:38.659480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.737892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185673d9-6392-4e8c-b682-b81f89705fc8 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:38.743243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:38.743832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:38.744118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:38.744432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:38.746295 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.758215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:38.759794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:38.769591 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1294/2594] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:38 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:38.876696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:38.878051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.893678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee0e68-c880-4874-b880-b4115dbc5140 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:38.898937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:38.899522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:38.899809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:38.900088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:38.901984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:38.913640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:38.915222 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:38.924945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1301/2595] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:38 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:45.242175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:45.244510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:45.334579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70460aa-a7d7-4a97-ba38-b6fce0197426 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:45.341237 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:45.341904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:45.342190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:45.342472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:45.344195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:45.356152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:45.357862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f06c7d-1b48-4047-bc1e-804776222a11 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:45.368326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1295/2596] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:45 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:05:49.786428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:49.787987 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:49.801759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67505c12-b99e-4b95-9951-d68cf6ff6af2 service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:49.806337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:49.807151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:49.807440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:49.807724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] PATH_INFO: `/v3/users/195a7a0b9bc946e8b24a6297b9f9c268` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:49.808874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195a7a0b9bc946e8b24a6297b9f9c268)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:49.810923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:49.884102 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195a7a0b9bc946e8b24a6297b9f9c268'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:49.892275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195a7a0b9bc946e8b24a6297b9f9c268'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:49.904608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195a7a0b9bc946e8b24a6297b9f9c268'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:49.905348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195a7a0b9bc946e8b24a6297b9f9c268'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:49.905933 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195a7a0b9bc946e8b24a6297b9f9c268'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:49.918476 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1302/2597] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:05:49 2021] DELETE /identity/v3/users/195a7a0b9bc946e8b24a6297b9f9c268 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:49.923089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:49.923600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:49.923694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:49.946073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:49.947267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:50.020129 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1296/2598] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:50.030600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.032039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:50.105675 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a96d-9464-4707-a67c-5b67d00c5cc5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.109619 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.110210 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.110496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.110770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.119553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.121044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e42f4e-ab74-441a-9167-2b59306bac61 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:50.130779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1303/2599] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:05:50.514511 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.516019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:50.527500 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7214a-80d9-4eb7-8612-afb8b8ad3755 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.532432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.533245 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.533535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.533814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] PATH_INFO: `/v3/projects/27563d15a96d4725b454d3affe91039b` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.534971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=27563d15a96d4725b454d3affe91039b)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.536985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:50.592856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27563d15a96d4725b454d3affe91039b', 'request_id': 'req-3b4c2e70-038b-480f-8fdd-ed5364a36aca'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:50.602925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27563d15a96d4725b454d3affe91039b', 'request_id': 'req-3b4c2e70-038b-480f-8fdd-ed5364a36aca'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:50.614460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27563d15a96d4725b454d3affe91039b', 'request_id': 'req-3b4c2e70-038b-480f-8fdd-ed5364a36aca'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:50.624812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] The token cache is being invalidate because project 27563d15a96d4725b454d3affe91039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:05:50.625092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:50.625744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-3b4c2e70-038b-480f-8fdd-ed5364a36aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:05:50.627234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1297/2600] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:05:50 2021] DELETE /identity/v3/projects/27563d15a96d4725b454d3affe91039b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:50.635529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.635814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.636093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.658671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:50.659775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:50.726390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1304/2601] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:05:50.734914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.735219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.735491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.759536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:50.760713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:50.768883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1298/2602] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:50.773312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.783269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828e86-c49f-44ec-b5f7-38e1d73e7214 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.788171 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.788908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.789010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.789326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.790001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:05:50.790299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.791883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:50.804875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1305/2603] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:05:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 13:05:50.809577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.819291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad881-87cc-4d0c-a26f-c1f0773d1786 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.824199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.824812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.825097 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.825371 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.826034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.828184 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:50.870302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1299/2604] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:05:50 2021] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:05:50.874984 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.885038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb05c-85e2-4dda-9dd7-96304c647afe admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.948780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.949300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.949591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.949873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.950524 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.952713 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:50.974090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1306/2605] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:05:50 2021] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:05:50.978528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:50.989066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae57f-9e35-474b-bd25-d55c44959587 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:50.994180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:50.994874 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:50.995228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:50.995586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:50.996724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:50.998394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:51.009166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1300/2606] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:51.013371 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:51.023162 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dc495-5384-4d3e-946b-2ae6bc11dce7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:51.027923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:51.028613 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:51.028900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:51.029189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:51.029894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:51.031676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb60f-8fb5-4237-b3e9-9ec1902e19a5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:51.042719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1307/2607] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:51.046871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:51.056501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2ba2e-051d-458d-8996-423ecf7a1812 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:51.061226 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:51.061975 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:51.062249 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:51.062531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] PATH_INFO: `/v3/projects/7d8b6261db1f41d39a82cf016dcfe817/users/39e11a5cfec24eabac7da23b114116a5/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:51.083939 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8b6261db1f41d39a82cf016dcfe817, user_id=39e11a5cfec24eabac7da23b114116a5, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:51.086592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:51.100335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1301/2608] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:05:51 2021] PUT /identity/v3/projects/7d8b6261db1f41d39a82cf016dcfe817/users/39e11a5cfec24eabac7da23b114116a5/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:51.105461 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5ede-c99f-4f39-9646-e351b83b607f None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:51.105759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5ede-c99f-4f39-9646-e351b83b607f None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:51.106046 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d5ede-c99f-4f39-9646-e351b83b607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:51.129565 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-3a1d5ede-c99f-4f39-9646-e351b83b607f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:51.130776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-3a1d5ede-c99f-4f39-9646-e351b83b607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:51.210638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1308/2609] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:51.221374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:51.223594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:51.298301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca3f3-30e3-4fbc-a039-0a6d92613c13 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:51.303535 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:51.304148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:51.304469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:51.304750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:51.315442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:51.317051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:51.326609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1302/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:05:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:05:57.707738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:57.708337 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:57.708453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:57.747662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] MFA Rules not processed for user `39e11a5cfec24eabac7da23b114116a5`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:05:57.748919 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:05:57.832213 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1309/2611] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:05:57 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:05:57.833558 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:57.843687 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760be62b-579c-4249-8e00-b4a5233ec82f service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:57.848792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:57.849465 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:57.849868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:57.850167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:57.851095 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:57.860171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:57.905729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1303/2612] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:05:57 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:05:57.909886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:57.920724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e36aa-4191-4979-a216-503adf70d5a1 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:57.983094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:57.983779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:57.984144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:57.984308 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:57.985015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:57.986980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:58.010451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1310/2613] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:05:57 2021] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:05:58.016413 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:58.026946 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e9418-bc1f-4ad9-9550-2db658f3afb3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:58.032407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:58.033020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:58.033304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:58.033605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:58.034304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:58.035917 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:58.046746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1304/2614] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:58.051386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:58.061954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e2dc1-945b-42b5-8d4d-89e2d896f2c1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:58.068588 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:58.069443 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:58.069685 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:58.069990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] PATH_INFO: `/v3/projects/389563fc6eac458d8f70ff247b60f54e/users/8fd28bd4d3ff4e929293aa54e0701246/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:58.091503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=389563fc6eac458d8f70ff247b60f54e, user_id=8fd28bd4d3ff4e929293aa54e0701246, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:58.094471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:58.109930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1311/2615] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:05:58 2021] PUT /identity/v3/projects/389563fc6eac458d8f70ff247b60f54e/users/8fd28bd4d3ff4e929293aa54e0701246/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:05:58.113814 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:58.123981 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07676-7a92-43eb-9b18-4502aac52656 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:58.192101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:58.192643 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:58.192935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:58.193214 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:58.193914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:58.195533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f985-864d-4a05-861c-520e38379fa1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:58.207090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1305/2616] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:05:58 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:05:58.211628 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:05:58.222506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326234a-eefa-48eb-9e93-29a3c413f35b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:05:58.227960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:05:58.228832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:05:58.229121 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:05:58.229411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] PATH_INFO: `/v3/projects/389563fc6eac458d8f70ff247b60f54e/users/8fd28bd4d3ff4e929293aa54e0701246/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:05:58.231381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389563fc6eac458d8f70ff247b60f54e, user_id=8fd28bd4d3ff4e929293aa54e0701246, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:05:58.234110 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:05:58.244018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1312/2617] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:05:58 2021] PUT /identity/v3/projects/389563fc6eac458d8f70ff247b60f54e/users/8fd28bd4d3ff4e929293aa54e0701246/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:06:04.705997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:06:04.706526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:06:04.706645 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:06:04.745787 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] MFA Rules not processed for user `8fd28bd4d3ff4e929293aa54e0701246`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:06:04.747334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:06:04.835067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1306/2618] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:06:04 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:06:04.846090 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:06:04.848642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:06:04.946126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ab8f5-48dd-4d86-867d-3f3c9e0f2ef2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:06:04.951236 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:06:04.951838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:06:04.952154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:06:04.952661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:06:05.025116 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:06:05.026770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:06:05.035880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1313/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:06:04 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:07:06.507307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:07:06.509570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:07:06.524424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615099c3-e17f-43c5-b52d-733909675d8f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:07:06.529757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:07:06.530350 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:07:06.530648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:07:06.530925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:07:06.532716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:07:06.603188 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:07:06.604988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:07:06.614217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1307/2620] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:07:06 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:07:23.880144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:07:23.881533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:07:23.959015 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd0bcd-531a-453d-8131-a63bc2f0608f service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:07:23.965080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:07:23.965668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:07:23.965962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:07:23.966237 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:07:23.969815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:07:23.985431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:07:23.987989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:07:24.002216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1314/2621] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:07:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:09:18.172757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:09:18.184889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c93d8-71dd-415c-a4ff-181538d7fe46 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:09:18.192264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:09:18.192900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:09:18.193215 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:09:18.193518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:09:18.195777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:18.261629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:09:18.263320 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:09:18.272114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1308/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:09:18 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:09:22.865880 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:09:22.866399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:22.948728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b673-8d76-4bc9-908a-d77fcff5a2ac service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:09:22.952494 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:09:22.953149 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:09:22.953504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:09:22.953849 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:09:22.955604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:22.969025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:09:22.972532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:09:22.986075 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1315/2623] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:09:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:09:23.010372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:09:23.011790 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:23.023766 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a6fba-ee88-4365-90d7-feaa6fc83df4 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:09:23.027782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:09:23.028539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:09:23.029013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:09:23.029296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:09:23.031136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:23.044966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:09:23.046416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:09:23.056941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1309/2624] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:09:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:09:27.681269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:09:27.692502 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e043b6-4d58-4c3e-b010-4a78a62d1128 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:09:27.699294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:09:27.699895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:09:27.700300 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:09:27.700612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:09:27.702610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:09:27.803894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:09:27.805530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:09:27.815074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1316/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:09:27 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:10:29.531288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:10:29.532944 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:10:29.599758 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999dbf8-bd71-408a-8ab1-8a5c2026767e service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:10:29.603616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:10:29.604180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:10:29.604475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:10:29.604769 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:10:29.606600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:10:29.616169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:10:29.617595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:10:29.626013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1310/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:10:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:10:36.960800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:10:36.971965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930956d-f7cb-4c09-a122-bd5e9a9d2676 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:10:36.975851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:10:36.976490 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:10:36.976745 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:10:36.977052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:10:36.978840 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:10:37.047472 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:10:37.048954 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:10:37.062291 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1317/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:10:36 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:11:05.494673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:11:05.504485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4447b-58d2-488f-a09c-469c95255707 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:11:05.508387 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:11:05.508955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:11:05.509241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:11:05.509521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:11:05.518364 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:11:05.519788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:11:05.528694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1311/2628] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:11:05 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:12:06.817530 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:12:06.899471 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb03296-e776-4bf7-bc76-124baaad46e5 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:12:06.905084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:12:06.905723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:12:06.906022 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:12:06.906303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:12:06.914731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:12:06.916389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:12:06.947603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1318/2629] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:12:06 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:12:26.824538 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:12:26.826106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:12:26.905803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f506ce8-38ca-49fb-b78a-5626429e893f service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:12:26.911477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:12:26.912027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:12:26.912340 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:12:26.912623 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:12:26.921036 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:12:26.922603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:12:26.931948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1312/2630] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:12:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:12:32.641714 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:12:32.655493 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df694a-f92d-49df-b44b-f1c5fd5707e2 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:12:32.661329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:12:32.662016 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:12:32.662441 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:12:32.662824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:12:32.664760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:12:32.695145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:12:32.697188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:12:32.711632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1319/2631] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:12:32 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:12:34.569491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:12:34.583156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e6077-6347-49e3-8b62-a4a194673670 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:12:34.589281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:12:34.589950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:12:34.590274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:12:34.590547 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:12:34.592290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:12:34.608331 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:12:34.610029 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:12:34.624577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1313/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:12:34 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:23.657271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:23.683600 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec715a7-1a44-408b-a0c2-2598a5e0cf10 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:23.689269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:23.689854 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:23.690138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:23.690396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:23.702436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:23.703882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:23.714520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1320/2633] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:14:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:24.887217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:24.902779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60adc-0279-4b3e-81a3-261041768405 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:24.907559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:24.908128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:24.908448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:24.908707 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:24.919630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:24.921149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:24.932122 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1314/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:14:24 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:34.587437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:34.610959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5313020-defc-4c50-95f1-111c0ddd2ebc service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:34.614971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:34.616082 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:34.616395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:34.616730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:34.626819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:34.628309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:34.660743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1321/2635] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:14:34 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:34.833953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:34.846030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793191b-aa29-46ce-b40e-ad39a20790c7 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:34.849242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:34.849837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:34.850878 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:34.851316 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:34.861888 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:34.863602 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:34.887449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1315/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:14:34 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:37.101615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:37.112681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6cbb9-17c5-4e8d-a6ff-885a1e2b3a1c service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:37.117458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:37.118043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:37.118326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:37.118599 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:37.120569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:14:37.221807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:37.223259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:37.245670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1322/2637] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:14:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:14:48.105476 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:48.106709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:14:48.121633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df485f-a967-444e-9133-dce560f3fde8 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:48.126875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:48.127681 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:48.127963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:48.128254 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] PATH_INFO: `/v3/users/e1f010313d3e4875994e8537e8c9c558` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:48.146941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f010313d3e4875994e8537e8c9c558)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:48.148895 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:48.207259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f010313d3e4875994e8537e8c9c558'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.215433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f010313d3e4875994e8537e8c9c558'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.227018 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f010313d3e4875994e8537e8c9c558'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.227700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f010313d3e4875994e8537e8c9c558'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.228419 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f010313d3e4875994e8537e8c9c558'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.241484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1316/2638] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:14:48 2021] DELETE /identity/v3/users/e1f010313d3e4875994e8537e8c9c558 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:14:48.474610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:48.484367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5e199-1e5d-43ad-9dae-6137e5a4f9db service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:48.574245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:48.575045 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:48.575333 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:48.575611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] PATH_INFO: `/v3/projects/a76cd93551c243ffac2329a86c7fce12` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:48.576916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76cd93551c243ffac2329a86c7fce12)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:48.578762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:48.628868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76cd93551c243ffac2329a86c7fce12', 'request_id': 'req-0d34439a-c82e-4d0d-bbd3-15364463c7fd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.638064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76cd93551c243ffac2329a86c7fce12', 'request_id': 'req-0d34439a-c82e-4d0d-bbd3-15364463c7fd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.656000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76cd93551c243ffac2329a86c7fce12', 'request_id': 'req-0d34439a-c82e-4d0d-bbd3-15364463c7fd'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.666031 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] The token cache is being invalidate because project a76cd93551c243ffac2329a86c7fce12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:14:48.666317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.666963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.668452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1323/2639] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:14:48 2021] DELETE /identity/v3/projects/a76cd93551c243ffac2329a86c7fce12 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:14:48.672610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:48.673985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:14:48.686686 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c2c9-322a-4b7f-a046-d27f25265e6f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:48.755868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:48.756659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:48.756947 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:48.757233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] PATH_INFO: `/v3/users/8073ab8f15c64c2e8adc6ce2cdc5d13c` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:48.777407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8073ab8f15c64c2e8adc6ce2cdc5d13c)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:48.779352 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:48.830101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8073ab8f15c64c2e8adc6ce2cdc5d13c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.837891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8073ab8f15c64c2e8adc6ce2cdc5d13c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.850084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8073ab8f15c64c2e8adc6ce2cdc5d13c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.850725 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8073ab8f15c64c2e8adc6ce2cdc5d13c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.851392 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8073ab8f15c64c2e8adc6ce2cdc5d13c'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:48.865616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1317/2640] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:14:48 2021] DELETE /identity/v3/users/8073ab8f15c64c2e8adc6ce2cdc5d13c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:14:49.108447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:14:49.110020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:14:49.123805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34439a-c82e-4d0d-bbd3-15364463c7fd admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:14:49.195454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:14:49.196705 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:14:49.197080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:14:49.197424 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] PATH_INFO: `/v3/projects/f9d41868988941708c26c7869f8c3a9a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:14:49.212824 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d41868988941708c26c7869f8c3a9a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:14:49.214738 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:14:49.269292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d41868988941708c26c7869f8c3a9a', 'request_id': 'req-1d8c2cb9-448e-48cc-b9b7-20176253e578'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:49.278944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d41868988941708c26c7869f8c3a9a', 'request_id': 'req-1d8c2cb9-448e-48cc-b9b7-20176253e578'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:49.290585 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d41868988941708c26c7869f8c3a9a', 'request_id': 'req-1d8c2cb9-448e-48cc-b9b7-20176253e578'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:49.300891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] The token cache is being invalidate because project f9d41868988941708c26c7869f8c3a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:14:49.301173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:49.301914 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:14:49.303478 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1324/2641] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:14:49 2021] DELETE /identity/v3/projects/f9d41868988941708c26c7869f8c3a9a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:15:34.497343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:15:34.499070 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:15:34.585705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651370db-089d-4a32-878a-9a39e00ce48b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:15:34.643000 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:15:34.643605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:15:34.643889 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:15:34.644168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:15:34.646064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:15:34.655651 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:15:34.657085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:15:34.665080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1318/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:15:34 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:15:38.097362 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:15:38.100901 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:15:38.186254 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2cb9-448e-48cc-b9b7-20176253e578 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:15:38.189886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:15:38.190466 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:15:38.190749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:15:38.191028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:15:38.192896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:15:38.287345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:15:38.288875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:15:38.308881 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1325/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:15:38 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:16:05.441180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:16:05.451659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d174927-0e35-4b98-8c4a-faee79b2054e service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:16:05.456258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:16:05.456862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:16:05.457153 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:16:05.457425 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:16:05.459531 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:16:05.565575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:16:05.567034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081542f-56e7-49ef-9401-e9cec4d631d6 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:16:05.586705 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1319/2644] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:16:05 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:17:26.506464 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:26.507923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:26.589077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f35a-068c-4ab8-a59f-bbe4141b1091 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:26.595316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:26.595981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:26.596295 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:26.596577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:26.598743 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:26.611575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:26.613547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:26.623430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1326/2645] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:17:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:17:28.009039 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:28.009697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:28.009697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:28.103280 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] MFA Rules not processed for user `f7e7bd8645b84c6bafd9304672d61a98`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:17:28.104398 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:28.184253 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1320/2646] 10.222.0.60 () {58 vars in 967 bytes} [Tue Nov 23 13:17:28 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:17:28.240507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:28.242026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:28.345007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4a18a-15ca-489f-8200-95bb385ae4cb service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:28.349955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb1451a2dbfe4b68a48d1dd9a31c09cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:28.350529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:28.350801 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:28.351103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:28.359679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:28.361256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:28.369720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1327/2647] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Nov 23 13:17:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 13:17:28.855290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:28.856879 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:28.872630 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e495b4c-e3c7-4dee-8dde-4d4782e0bd00 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:28.876578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:28.877165 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:28.877513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:28.878146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:28.879525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:28.952436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:28.953890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:28.964296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1321/2648] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:17:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:17:40.262924 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:40.264536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:40.278017 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a230ca-c5a7-4e2d-ba10-af5de0bece9b service swift] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:40.282598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:40.283404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:40.283681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:40.283956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] PATH_INFO: `/v3/users/b10dad24cdfa4e128b19e01548066a84` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:40.302701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10dad24cdfa4e128b19e01548066a84)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:40.304668 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:40.358482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10dad24cdfa4e128b19e01548066a84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.366993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10dad24cdfa4e128b19e01548066a84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.379509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10dad24cdfa4e128b19e01548066a84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.380190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10dad24cdfa4e128b19e01548066a84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.380832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10dad24cdfa4e128b19e01548066a84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.395249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1328/2649] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:17:40 2021] DELETE /identity/v3/users/b10dad24cdfa4e128b19e01548066a84 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:17:40.640216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:40.651066 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf90f-2174-498c-b9f7-03e97172c505 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:40.716357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:40.717146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:40.717429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:40.717708 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] PATH_INFO: `/v3/projects/13128fc1ba014300bfb802722969331f` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:40.718840 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=13128fc1ba014300bfb802722969331f)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:40.720782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:40.774283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13128fc1ba014300bfb802722969331f', 'request_id': 'req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.783943 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13128fc1ba014300bfb802722969331f', 'request_id': 'req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.796332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13128fc1ba014300bfb802722969331f', 'request_id': 'req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.807577 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] The token cache is being invalidate because project 13128fc1ba014300bfb802722969331f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:17:40.807913 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.808678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.810714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1322/2650] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:17:40 2021] DELETE /identity/v3/projects/13128fc1ba014300bfb802722969331f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:17:40.814509 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:40.815890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:40.829336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580b9f-5b1c-42c7-9344-011d3d0e9895 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:40.895678 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:40.896548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:40.896836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:40.897112 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] PATH_INFO: `/v3/users/5626d4903bcb44fe999834f384f13f5f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:40.915760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5626d4903bcb44fe999834f384f13f5f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:40.917957 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:40.971279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5626d4903bcb44fe999834f384f13f5f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.979244 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5626d4903bcb44fe999834f384f13f5f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.991358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5626d4903bcb44fe999834f384f13f5f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.992050 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5626d4903bcb44fe999834f384f13f5f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:40.992687 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5626d4903bcb44fe999834f384f13f5f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.006217 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1329/2651] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:17:40 2021] DELETE /identity/v3/users/5626d4903bcb44fe999834f384f13f5f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:17:41.245982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:17:41.247832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:17:41.263078 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27276-3753-48d2-9d8d-2d09b1bbf8cf admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:17:41.337998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:17:41.338826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:17:41.339109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:17:41.339451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] PATH_INFO: `/v3/projects/be308acf515d4669907fda5a4d8ac963` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:17:41.356136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be308acf515d4669907fda5a4d8ac963)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:17:41.358457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:17:41.414521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be308acf515d4669907fda5a4d8ac963', 'request_id': 'req-56da784b-2cd8-40bd-aafa-faf3a85a9456'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.423208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be308acf515d4669907fda5a4d8ac963', 'request_id': 'req-56da784b-2cd8-40bd-aafa-faf3a85a9456'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.435988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be308acf515d4669907fda5a4d8ac963', 'request_id': 'req-56da784b-2cd8-40bd-aafa-faf3a85a9456'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.447519 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] The token cache is being invalidate because project be308acf515d4669907fda5a4d8ac963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:17:41.447795 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.448474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:17:41.450323 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1323/2652] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:17:41 2021] DELETE /identity/v3/projects/be308acf515d4669907fda5a4d8ac963 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:18:08.410948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:08.412741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:08.483799 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae778-1ed1-4b1b-b2fe-49dde10ba96b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:08.546451 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:08.547035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:08.547316 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:08.547590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:08.549463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:08.625353 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:08.626807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:08.638826 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1330/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:18:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:18:19.880646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:19.887388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:19.908169 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da784b-2cd8-40bd-aafa-faf3a85a9456 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:19.913506 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:19.914360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:19.914638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:19.914920 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] PATH_INFO: `/v3/users/39e11a5cfec24eabac7da23b114116a5` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:19.916084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e11a5cfec24eabac7da23b114116a5)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:19.918059 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:19.983735 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e11a5cfec24eabac7da23b114116a5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:19.999154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e11a5cfec24eabac7da23b114116a5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.020984 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e11a5cfec24eabac7da23b114116a5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.021942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e11a5cfec24eabac7da23b114116a5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.022656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e11a5cfec24eabac7da23b114116a5'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.038448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1324/2654] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:18:19 2021] DELETE /identity/v3/users/39e11a5cfec24eabac7da23b114116a5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:18:20.331479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:20.342857 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509c89-14be-4311-94e0-f20e204642b8 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:20.420403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:20.421223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:20.421504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:20.421781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] PATH_INFO: `/v3/projects/7d8b6261db1f41d39a82cf016dcfe817` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:20.422927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8b6261db1f41d39a82cf016dcfe817)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:20.424909 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:20.485111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8b6261db1f41d39a82cf016dcfe817', 'request_id': 'req-d6c848de-d723-4bc4-adba-3f69b83e276f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.494779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8b6261db1f41d39a82cf016dcfe817', 'request_id': 'req-d6c848de-d723-4bc4-adba-3f69b83e276f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.507176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8b6261db1f41d39a82cf016dcfe817', 'request_id': 'req-d6c848de-d723-4bc4-adba-3f69b83e276f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.520953 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] The token cache is being invalidate because project 7d8b6261db1f41d39a82cf016dcfe817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:18:20.521403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.522401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.525005 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1331/2655] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:18:20 2021] DELETE /identity/v3/projects/7d8b6261db1f41d39a82cf016dcfe817 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:18:20.529655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:20.531239 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:20.548627 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6bb29-c8c4-4d71-86c1-4a29b7817e15 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:20.641752 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:20.642569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:20.642851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:20.643132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] PATH_INFO: `/v3/users/8fd28bd4d3ff4e929293aa54e0701246` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:20.667227 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd28bd4d3ff4e929293aa54e0701246)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:20.669256 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:20.730771 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd28bd4d3ff4e929293aa54e0701246'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.739704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd28bd4d3ff4e929293aa54e0701246'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.751746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd28bd4d3ff4e929293aa54e0701246'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.752460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd28bd4d3ff4e929293aa54e0701246'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.753152 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd28bd4d3ff4e929293aa54e0701246'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:20.773278 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1325/2656] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:18:20 2021] DELETE /identity/v3/users/8fd28bd4d3ff4e929293aa54e0701246 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:18:21.104944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:21.106389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:21.120190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c848de-d723-4bc4-adba-3f69b83e276f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:21.195246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:21.196408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:21.196408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:21.196776 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] PATH_INFO: `/v3/projects/389563fc6eac458d8f70ff247b60f54e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:21.211144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389563fc6eac458d8f70ff247b60f54e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:21.213479 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:21.287884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389563fc6eac458d8f70ff247b60f54e', 'request_id': 'req-698bc294-e74e-44f5-8a17-87da7ec6f933'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:21.297819 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389563fc6eac458d8f70ff247b60f54e', 'request_id': 'req-698bc294-e74e-44f5-8a17-87da7ec6f933'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:21.314579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389563fc6eac458d8f70ff247b60f54e', 'request_id': 'req-698bc294-e74e-44f5-8a17-87da7ec6f933'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:21.328271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] The token cache is being invalidate because project 389563fc6eac458d8f70ff247b60f54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:18:21.328563 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:21.329215 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:18:21.330939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1332/2657] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:18:21 2021] DELETE /identity/v3/projects/389563fc6eac458d8f70ff247b60f54e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:18:36.710053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:18:36.713360 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:36.834003 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdae71-8cff-48b0-a799-e25c323b7479 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:18:36.914745 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:18:36.915346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:18:36.915773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:18:36.916075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:18:36.917873 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:18:36.930571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:18:36.932106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:18:36.944343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1326/2658] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:18:36 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:19:23.475900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:19:23.478301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:23.556067 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bc294-e74e-44f5-8a17-87da7ec6f933 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:19:23.561206 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:19:23.561838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:19:23.562124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:19:23.562405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:19:23.564462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:23.580836 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:19:23.583123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:19:23.595830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1333/2659] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:19:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:19:25.699367 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:19:25.701727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:25.715747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb0ea8-b392-4a62-a636-9f518686e1c7 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:19:25.720781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:19:25.721363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:19:25.721652 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:19:25.721932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:19:25.724270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:25.744859 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:19:25.746287 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:19:25.759333 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1327/2660] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:19:25 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:19:34.167010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:19:34.168920 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:34.188573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa907-39c7-46a0-872e-7a0ddff52ac2 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:19:34.197063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:19:34.198043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:19:34.198594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:19:34.198900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:19:34.201597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:19:34.308990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:19:34.310640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce72322-5840-4c4c-8bd7-99bae13769e7 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:19:34.321150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1334/2661] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:19:34 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:38.576414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:38.587999 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e425-0223-4089-a2b4-8ffd5c2d1c05 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:38.593738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:38.594399 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:38.595043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:38.595043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:38.597338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:38.689393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:38.691327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:38.702241 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1328/2662] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:38 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:41.592274 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:41.592971 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:41.593190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:41.647011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] MFA Rules not processed for user `4540fb62ff264ba4929a567b548de846`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:20:41.648918 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:41.657823 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1335/2663] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:20:41 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:20:42.159998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:42.172279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62734e-143c-46dd-bacd-af6ffd97994d service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:42.179304 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:42.180132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:42.180556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:42.180923 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:42.183885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:42.198779 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:42.200794 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:42.213955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1329/2664] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:42 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:42.760367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:42.761746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:42.855965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da3a6-20be-4920-8ad1-4df0c5c49761 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:42.855965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:42.855965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:42.855965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:42.856459 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:42.858529 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:42.870113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:42.871699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:42.881150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1336/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:42.989659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:42.991134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:43.006495 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae56a-5e57-45a4-8a8f-defbd6c481e5 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:43.011861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:43.012513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:43.012810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:43.013090 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:43.015024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:43.031442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:43.033882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:43.043594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1330/2666] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:45.066463 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:45.076837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790a94-abbe-4adb-9be7-41859cba00bf service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:45.086319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:45.086942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:45.087289 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:45.087800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:45.089758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:45.100891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:45.102428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:45.111270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1337/2667] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:45 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:20:52.203978 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:20:52.220083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4c2d-76ab-4dff-b9b0-fb6072832e89 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:20:52.226497 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:20:52.227079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:20:52.227362 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:20:52.227636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:20:52.232781 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:20:52.246518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:20:52.248140 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:20:52.259541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1331/2668] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:20:52 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:22:32.757184 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:22:32.836468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d0013-54ff-4bb6-b50f-097749889c87 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:22:32.842574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:22:32.843182 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:22:32.843458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:22:32.843765 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:22:32.845700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:22:32.889544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:22:32.891150 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:22:32.901129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1338/2669] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:22:32 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:24:34.550552 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:24:34.552427 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:24:34.665716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850d8ac-b62f-496c-8da6-f91120a3016b service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:24:34.669671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:24:34.670242 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:24:34.670518 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:24:34.670793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:24:34.679772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:24:34.681217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:24:34.690654 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1332/2670] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:24:34 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:25:37.611741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:25:37.613336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:25:37.625581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c029c2-9017-4755-b949-a2e63e91ab30 service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:25:37.634571 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:25:37.635172 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:25:37.635454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:25:37.635730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:25:37.645991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:25:37.647893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:25:37.659278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1339/2671] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:25:37 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:25:44.481193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:25:44.504562 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b35a-d361-4704-ab3b-7e92d214acf1 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:25:44.508998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:25:44.509613 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:25:44.509897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:25:44.510179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:25:44.518484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:25:44.520032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:25:44.528807 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1333/2672] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:25:44 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:27:36.742532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:27:36.754686 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397f876-c171-4fd8-91e5-d042db4b63f8 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:27:36.760104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:27:36.760759 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:27:36.761070 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:27:36.761350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:27:36.771754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:27:36.773375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:27:36.783553 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1340/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:27:36 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:28:08.281481 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:28:08.291472 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6417e-0d2b-440c-9376-4a088a0a410b service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:28:08.296855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:28:08.297615 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:28:08.297992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:28:08.298342 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:28:08.324115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:28:08.325589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:28:08.349517 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1334/2674] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:28:08 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:28:09.621477 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:28:09.632103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad9b38-510e-4fb9-b7e8-c02a4fb3a461 service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:28:09.636181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:28:09.636820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:28:09.637109 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:28:09.637390 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:28:09.649381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:28:09.651180 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:28:09.662692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1341/2675] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:28:09 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:28:10.706949 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:28:10.713259 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:28:10.754695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad45f-452c-46b0-92de-8108a858ad46 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:28:10.760027 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:28:10.760667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:28:10.760954 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:28:10.761288 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:28:10.771168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:28:10.773071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:28:10.784077 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1335/2676] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:28:10 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:29:35.260278 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:29:35.270212 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97357-e47a-4810-9124-3cb0e967205a service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:29:35.274548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:29:35.275126 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:29:35.275401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:29:35.275645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:29:35.278028 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:29:35.394499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:29:35.395864 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:29:35.416359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1342/2677] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:29:35 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:30:38.803038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:30:38.814056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5417-e2ca-4537-a990-a05edf89eae3 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:30:38.818424 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:30:38.819015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:30:38.819275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:30:38.819563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:30:38.822289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:30:38.920294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:30:38.921757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:30:38.942434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1336/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:30:38 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:32:41.715409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:32:41.717049 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:32:41.851656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffb43-0931-456d-92d9-ffcfefd52430 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:32:41.857228 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:32:41.857825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:32:41.858097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:32:41.858394 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:32:41.860415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:32:41.873584 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:32:41.875229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:32:41.886262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1343/2679] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:32:41 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:34:34.122553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:34:34.132013 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5cbd-e3e8-42d2-8e4d-91f51831d8a5 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:34:34.136258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:34:34.136868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:34:34.137160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:34:34.137434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:34:34.147804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:34:34.149322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:34:34.158972 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1337/2680] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:34:34 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:35:39.542035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:35:39.543813 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:35:39.696314 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc2e21-20ef-4d72-9a66-468344b017c7 service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:35:39.701181 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:35:39.701808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:35:39.702101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:35:39.702382 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:35:39.712205 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:35:39.714232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:35:39.726602 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1344/2681] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:35:39 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:37:48.740072 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:37:48.742625 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:37:48.774289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519a99-13c4-4653-a821-e3c5ae1979f1 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:37:48.780409 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:37:48.780990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:37:48.781269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:37:48.781569 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:37:48.791351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:37:48.793170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:37:48.804155 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1338/2682] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:37:48 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:38:04.053339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:38:04.055409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:38:04.155065 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0ee50-1d60-400d-bc4c-f0f017793aa3 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:38:04.159803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:38:04.160462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:38:04.160751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:38:04.161038 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:38:04.163097 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:38:04.276643 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:38:04.278851 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:38:04.308679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1345/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:38:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:38:05.114948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:38:05.116529 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:38:05.132311 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e31f-6b61-4c32-b779-7a33e496bba2 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:38:05.138567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:38:05.139731 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:38:05.140133 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:38:05.140441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] PATH_INFO: `/v3/users/6eb8e090f8ae4a2381c9b82a8090f112` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:38:05.141639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb8e090f8ae4a2381c9b82a8090f112)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:38:05.143477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:38:05.203251 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb8e090f8ae4a2381c9b82a8090f112'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.213012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb8e090f8ae4a2381c9b82a8090f112'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.229883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb8e090f8ae4a2381c9b82a8090f112'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.230854 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb8e090f8ae4a2381c9b82a8090f112'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.231578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb8e090f8ae4a2381c9b82a8090f112'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.247279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1339/2684] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:38:05 2021] DELETE /identity/v3/users/6eb8e090f8ae4a2381c9b82a8090f112 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:38:05.527410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:38:05.538128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b1f9-cdc9-4df6-9b3a-df9371768db6 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:38:05.613595 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:38:05.614435 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:38:05.614719 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:38:05.615002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] PATH_INFO: `/v3/projects/90112b6f3d31421a8ee18cbe7d6b0537` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:38:05.616154 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90112b6f3d31421a8ee18cbe7d6b0537)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:38:05.618120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:38:05.671354 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90112b6f3d31421a8ee18cbe7d6b0537', 'request_id': 'req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.680081 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90112b6f3d31421a8ee18cbe7d6b0537', 'request_id': 'req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.693246 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90112b6f3d31421a8ee18cbe7d6b0537', 'request_id': 'req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.706863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] The token cache is being invalidate because project 90112b6f3d31421a8ee18cbe7d6b0537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:38:05.707186 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.707877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:38:05.709519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1346/2685] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:38:05 2021] DELETE /identity/v3/projects/90112b6f3d31421a8ee18cbe7d6b0537 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:39:34.793279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:39:34.794849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:39:34.970453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75772528-adee-45fd-9ba8-7d98a55dabca admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:39:35.026896 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:39:35.027493 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:39:35.027777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:39:35.028058 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:39:35.029948 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:39:35.097244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:39:35.098574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:39:35.107646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1340/2686] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:39:34 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:14.897384 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:14.898969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:14.969140 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6201c40-cdb5-4e11-9a48-a91c3c3ae89b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:14.974156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:14.974780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:14.975072 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:14.975350 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:14.977544 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:15.052190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:15.053667 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:15.063375 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1347/2687] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:20.402693 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:20.404132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:20.419030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc131c-4c38-49cd-9271-b62de2179b20 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:20.424661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:20.425473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:20.425804 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:20.426086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] PATH_INFO: `/v3/users/4540fb62ff264ba4929a567b548de846` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:20.445219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4540fb62ff264ba4929a567b548de846)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:20.447158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:20.511503 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4540fb62ff264ba4929a567b548de846'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.520756 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4540fb62ff264ba4929a567b548de846'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.533542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4540fb62ff264ba4929a567b548de846'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.534197 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4540fb62ff264ba4929a567b548de846'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.534842 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-dfcb829d-94aa-4f3c-9887-9f45513191c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4540fb62ff264ba4929a567b548de846'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.547700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1341/2688] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:40:20 2021] DELETE /identity/v3/users/4540fb62ff264ba4929a567b548de846 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:40:20.779941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:20.790190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09602fa7-aad4-4b6b-a104-7473e284e678 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:20.855862 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:20.856754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:20.857105 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:20.857386 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] PATH_INFO: `/v3/projects/d3e13e13e1e54f208b7be1c18e3ab703` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:20.875768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e13e13e1e54f208b7be1c18e3ab703)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:20.878638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:20.960069 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e13e13e1e54f208b7be1c18e3ab703', 'request_id': 'req-0dfa6187-4c45-491e-a604-d2bf214e8ffb'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.970324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e13e13e1e54f208b7be1c18e3ab703', 'request_id': 'req-0dfa6187-4c45-491e-a604-d2bf214e8ffb'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.981794 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e13e13e1e54f208b7be1c18e3ab703', 'request_id': 'req-0dfa6187-4c45-491e-a604-d2bf214e8ffb'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.992151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] The token cache is being invalidate because project d3e13e13e1e54f208b7be1c18e3ab703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:40:20.992474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.993202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-0dfa6187-4c45-491e-a604-d2bf214e8ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:40:20.994718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1348/2689] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:40:20 2021] DELETE /identity/v3/projects/d3e13e13e1e54f208b7be1c18e3ab703 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:40:21.001684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.001990 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.002272 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.075004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:40:21.076406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:21.146343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1342/2690] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:40:21.154834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.155120 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.155409 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.179648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:40:21.180825 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:21.189259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1349/2691] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:40:21.193570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.203611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6035064-8c65-41ed-9f3f-3b180c250dd0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.209405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.209997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.210370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.210563 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.211244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:40:21.211578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.213224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.226351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1343/2692] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:40:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:40:21.230669 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.239891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3384e4-f2aa-4ef2-ac64-b0d32ec263fd None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.244543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.245132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.245415 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.245691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.246327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.248429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.297329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1350/2693] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:40:21 2021] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:40:21.301865 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.312510 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ea946-9225-46be-bdfe-ced4c8f8adde admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.396074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.396832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.397154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.397485 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.398135 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.400341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.425064 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1344/2694] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:40:21 2021] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:40:21.429641 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.440473 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4e690-19c0-4978-98f7-2494a7a022b2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.446197 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.446792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.447074 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.447349 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.448058 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.449697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.461203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1351/2695] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:40:21.465209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.475515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991841-ce8f-44ae-93e8-919607d35ad5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.480372 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.480971 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.481243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.481524 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.482544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.484105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672673c8-4052-49ad-b71c-64d17c63e3f5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.494265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1345/2696] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:40:21.499001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.509911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fa683-8fc5-486f-b79f-881fc981fdca admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.515682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.516576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.516859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.517133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] PATH_INFO: `/v3/projects/c610ba775aca44aa85aaf415f96bb37e/users/5e5e06990f874a099eb9f92dde95e85d/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.538612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c610ba775aca44aa85aaf415f96bb37e, user_id=5e5e06990f874a099eb9f92dde95e85d, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.541438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.558312 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1352/2697] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:40:21 2021] PUT /identity/v3/projects/c610ba775aca44aa85aaf415f96bb37e/users/5e5e06990f874a099eb9f92dde95e85d/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:40:21.564009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df20e-4846-41b1-aecf-6ccd3bec6390 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.564326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df20e-4846-41b1-aecf-6ccd3bec6390 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.564639 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df20e-4846-41b1-aecf-6ccd3bec6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.587724 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-2f9df20e-4846-41b1-aecf-6ccd3bec6390 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:40:21.588955 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-2f9df20e-4846-41b1-aecf-6ccd3bec6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:21.655559 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1346/2698] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:40:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:40:21.666202 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:21.667965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:21.735528 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62147ccf-3851-4a45-a134-559e794e263b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:21.740077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:21.740698 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:21.740985 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:21.741262 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:21.751343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:21.752863 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:21.761906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1353/2699] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:27.737187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203e15-6c68-441d-ae11-98a96e007f2d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:27.738138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203e15-6c68-441d-ae11-98a96e007f2d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:27.738138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203e15-6c68-441d-ae11-98a96e007f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:27.780441 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-ea203e15-6c68-441d-ae11-98a96e007f2d None None] MFA Rules not processed for user `5e5e06990f874a099eb9f92dde95e85d`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:40:27.781609 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-ea203e15-6c68-441d-ae11-98a96e007f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:27.860673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1347/2700] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:40:27 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:40:27.874704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:27.876568 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:27.994137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f8f5-139e-4e69-bd75-75585aab5bd0 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:28.005007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:28.005834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:28.006208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:28.006548 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:28.018229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:28.019894 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:28.029890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1354/2701] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:27 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:29.994212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:29.995110 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:29.995574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:30.020438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] MFA Rules not processed for user `5e5e06990f874a099eb9f92dde95e85d`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:40:30.021669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:30.042190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1348/2702] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:40:29 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:40:30.080793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:30.082277 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:30.187790 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d59f85-3414-4b78-9c68-60b802ee6d5a service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:30.192174 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ba29c5b041e431ca8660c2d2ca8aee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:30.192830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:30.193103 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:30.193401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:30.195411 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:30.210575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:30.213027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:30.224793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1355/2703] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:30 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:30.611610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:30.613616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:30.626490 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a872d0-dc48-493d-a4f8-af9b4b423df0 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:30.630421 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:30.631067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:30.631351 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:30.631628 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:30.634025 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:30.648576 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:30.650023 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:30.674605 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1349/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:30 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:31.203475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:31.204928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:31.213676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:31.224145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df89cb-92fc-4bee-8ffa-b3c024f25d23 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:31.228181 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:31.228935 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:31.229281 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:31.229655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:31.231496 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:31.245533 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:31.247301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:31.259220 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1350/2705] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:31 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:31.293780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ced890-5b8c-44c6-86d1-a650045c06da service glance] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:31.299003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:31.299614 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:31.299895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:31.300169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:31.301888 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:31.313803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:31.315517 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:31.326145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1356/2706] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:31 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:31.438004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:31.439354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:31.453081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604a05-52b1-4a01-b2cf-a86452be998c service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:31.459477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:31.460065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:31.460388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:31.460667 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:31.462374 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:31.473941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:31.475540 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:31.485162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1351/2707] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:31 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:33.547482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:33.557978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bcbae-c373-438b-8e06-d128273d1cde service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:33.562039 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:33.562611 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:33.562903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:33.563169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:33.565106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:33.575313 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:33.576807 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:33.586156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1357/2708] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:33 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:34.636436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:34.638566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:34.659103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa7d6-05aa-4b83-a22f-9022bb582b73 service placement] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:34.666293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:34.667174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:34.667661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:34.668116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:34.670086 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:34.684151 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:34.686982 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:34.697219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1352/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:34 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:42.098252 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:42.114098 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b86e6-01af-434d-8fb6-5e4485d01acb service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:42.119549 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:42.120129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:42.120485 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:42.120766 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:42.122681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:42.137280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:42.139778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:42.150774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1358/2710] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:40:47.117369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:40:47.131685 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e7f99-45de-45a2-a9f3-2b507ddded32 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:40:47.137541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:40:47.138125 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:40:47.138407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:40:47.138680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:40:47.140610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:40:47.153221 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:40:47.154851 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887f54c-e87c-4bae-8523-dfc47687e949 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:40:47.170437 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1353/2711] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:40:47 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:42:53.788610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:42:53.843736 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fef2a-5e1d-486e-83e9-f9c2bf8049a1 service nova] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:42:53.850001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:42:53.850575 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:42:53.850860 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:42:53.851138 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:42:53.853018 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:42:53.883321 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:42:53.884990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:42:53.894622 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1359/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:42:53 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:45:09.270726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:45:09.271376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:45:09.271376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:45:09.295695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] MFA Rules not processed for user `5e5e06990f874a099eb9f92dde95e85d`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:45:09.296959 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:45:09.304810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1354/2713] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:45:09 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:45:09.773264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:45:09.782671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadbd75-b41b-4012-abad-9d51219c05c2 service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:45:09.787828 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:45:09.788603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:45:09.788906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:45:09.789193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:45:09.790995 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:45:09.802243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:45:09.803701 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:45:09.812132 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1360/2714] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:45:09 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:45:28.432293 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:45:28.450478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981ad6f-ad0c-4c96-a007-d0858c53500d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:45:28.458586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:45:28.459574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:45:28.459832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:45:28.460123 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:45:28.468819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:45:28.470405 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:45:28.479282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1355/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:45:28 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:46:01.436053 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:46:01.445280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8618-7213-4522-8375-7cbf83108e44 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:46:01.450003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:46:01.450797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:46:01.451219 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:46:01.451591 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:46:01.460437 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:46:01.461874 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:46:01.470603 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1361/2716] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:46:01 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:46:40.896403 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:46:40.897929 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:46:41.024087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca60b8f-bb27-442a-ac72-8e35de992642 service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:46:41.030243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:46:41.031038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:46:41.031473 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:46:41.031904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:46:41.045099 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:46:41.047079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:46:41.059365 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1356/2717] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:46:40 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:46:51.122711 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:46:51.133101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2457e-f333-46d4-8708-d2854fb0c527 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:46:51.137605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:46:51.138176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:46:51.138460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:46:51.138734 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:46:51.149777 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:46:51.151211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:46:51.163367 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1362/2718] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:46:51 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:23.981970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:24.014660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97beb4b-34df-41fd-bc87-2860e9ba71cc service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:24.023590 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ec290df16034659ad193a9b20f7507e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:24.025940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:24.026595 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:24.027698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:24.043554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:24.047586 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:24.084482 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1357/2719] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:30.742796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:30.753634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2da95-1392-49ca-a9e8-4d3b9af7088c service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:30.758287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:30.758884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:30.759179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:30.759448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:30.776041 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:30.777598 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:30.787266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1363/2720] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:36.025777 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.041953 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4281a3-e064-4481-ad2f-a3aa92c4c88c service nova] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.049638 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.050444 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.050729 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.051007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] PATH_INFO: `/v3/users/5e5e06990f874a099eb9f92dde95e85d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.052170 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5e06990f874a099eb9f92dde95e85d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.054145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.106672 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5e06990f874a099eb9f92dde95e85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.116159 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5e06990f874a099eb9f92dde95e85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.128438 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5e06990f874a099eb9f92dde95e85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.129134 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5e06990f874a099eb9f92dde95e85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.129797 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2538edd6-6be4-451c-9005-6475a2caf500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5e06990f874a099eb9f92dde95e85d'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.143270 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1358/2721] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:36 2021] DELETE /identity/v3/users/5e5e06990f874a099eb9f92dde95e85d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:36.387944 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.398761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f793ff-0e69-4c82-b389-3fbe8ac4eb65 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.473754 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.474581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.474865 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.475137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] PATH_INFO: `/v3/projects/c610ba775aca44aa85aaf415f96bb37e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.476348 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c610ba775aca44aa85aaf415f96bb37e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.478303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.531648 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c610ba775aca44aa85aaf415f96bb37e', 'request_id': 'req-59e0f077-94c3-46c7-9dc0-e7c9454171ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.540500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c610ba775aca44aa85aaf415f96bb37e', 'request_id': 'req-59e0f077-94c3-46c7-9dc0-e7c9454171ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.552151 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c610ba775aca44aa85aaf415f96bb37e', 'request_id': 'req-59e0f077-94c3-46c7-9dc0-e7c9454171ce'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.563516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] The token cache is being invalidate because project c610ba775aca44aa85aaf415f96bb37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:36.563798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.564633 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-59e0f077-94c3-46c7-9dc0-e7c9454171ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:36.566245 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1364/2722] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:36 2021] DELETE /identity/v3/projects/c610ba775aca44aa85aaf415f96bb37e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:36.572417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.572713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.572994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.596658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:36.597882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:36.687676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1359/2723] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:36.695948 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.696257 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.696550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.720891 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:36.722096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:36.731159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1365/2724] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:36.735770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.745861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732ba52-f318-4c3d-ae3f-599cd26721cb None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.751596 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.752415 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.752699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.753001 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.753695 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:47:36.753993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.755726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.769869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1360/2725] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:47:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:47:36.774338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.783710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e45c4-3ddb-481e-8cc9-a3d256c7b56a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.789523 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.790179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.790452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.790833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.791383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.793507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.824468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1366/2726] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:36 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:36.828997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.839662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafc86e-32af-40da-8055-d3d951f008b0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.902658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.903257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.903555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.903812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.904505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.906480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.930422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1361/2727] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:36 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:36.935327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.947133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0074b7-f6c4-4333-8e99-bef93196e981 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.952216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.952890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.953175 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.953454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.954161 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.955962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:36.967487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1367/2728] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:36.971880 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:36.982301 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea4bf-7c87-41f1-8056-54de9d9cba1c admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:36.988673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:36.989257 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:36.989541 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:36.989817 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:36.990509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:36.992103 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b28b0-d802-4aeb-8790-f4f9bf7eb128 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.002789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1362/2729] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:37.007226 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.017770 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5bcf-45b8-4afe-ade7-e0cbad3c75c3 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.022653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.023428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.023717 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.024002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] PATH_INFO: `/v3/projects/19e90cdcf6ba4460a09738a4a310516d/users/9444faf676ba44be82bbd4db2b518494/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.045809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e90cdcf6ba4460a09738a4a310516d, user_id=9444faf676ba44be82bbd4db2b518494, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.048541 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.066728 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1368/2730] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:37 2021] PUT /identity/v3/projects/19e90cdcf6ba4460a09738a4a310516d/users/9444faf676ba44be82bbd4db2b518494/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:47:37.077232 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.077733 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.077818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.116806 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] MFA Rules not processed for user `9444faf676ba44be82bbd4db2b518494`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:37.118002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:37.195229 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1363/2731] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:37.200271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.283715 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080822-4e72-4978-9b34-b088ac9b4813 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.288208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.288816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.289100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.289374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.290003 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.291895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.319543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1369/2732] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:37.323857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.336407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690065e-a9d2-4e8a-8636-f3c83efa1b49 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.412474 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.413071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.413359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.413661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.414317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.416274 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.441600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1364/2733] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:47:37.446639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.460283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118c5d-f59c-46d3-a1b0-0707dc507606 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.465725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.466328 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.466610 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.466886 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.467583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.469237 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.480336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1370/2734] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:37.484689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.495384 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ecd1-29c2-4c06-9208-ce0bca2b840b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.500934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.501545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.501862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.502322 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.503102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.504750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab85c11-5fca-4a1b-80e7-e348d3780929 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.515211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1365/2735] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:37.520080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.535906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74bd54-eafc-46f2-9001-2c1df18a29f0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.543786 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.545148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.545620 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.546093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] PATH_INFO: `/v3/projects/aa6274e79c3b4914915eb58e1f1bf4b0/users/d0555f448e794e6888bfb1b608b88c33/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.568778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6274e79c3b4914915eb58e1f1bf4b0, user_id=d0555f448e794e6888bfb1b608b88c33, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.571430 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.586735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1371/2736] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:37 2021] PUT /identity/v3/projects/aa6274e79c3b4914915eb58e1f1bf4b0/users/d0555f448e794e6888bfb1b608b88c33/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:37.598487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.598792 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.599074 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.641373 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] MFA Rules not processed for user `d0555f448e794e6888bfb1b608b88c33`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:37.643105 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:37.726354 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1366/2737] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:37.731024 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.803178 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b22fae-05f8-42d2-87ff-c78c3dec6c46 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.808639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.809249 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.809535 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.809837 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.810492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.812468 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.841334 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1372/2738] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:37.845858 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.856816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1d26-05d5-425d-a838-d6570190b114 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.943216 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.943957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.944260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.944579 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.945223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.947158 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:37.969621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1367/2739] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:37 2021] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:47:37.973962 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:37.984134 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b7c-3a82-4e9e-8e2c-d05ee2283fba admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:37.989798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:37.990399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:37.990702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:37.991100 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:37.991803 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:37.993431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:38.005048 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1373/2740] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:38.010019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:38.023217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb97c2-5340-4d28-b2f2-65ecbc51f1ac admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:38.029458 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:38.030556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:38.030938 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:38.031296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] PATH_INFO: `/v3/projects/66808171b82e49c28e3a25f96351a7ec/users/1477b202510347dbbebcb66139cee153/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:38.058267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66808171b82e49c28e3a25f96351a7ec, user_id=1477b202510347dbbebcb66139cee153, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:38.061156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:38.079487 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1368/2741] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:38 2021] PUT /identity/v3/projects/66808171b82e49c28e3a25f96351a7ec/users/1477b202510347dbbebcb66139cee153/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:38.084601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:38.094834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71a4d-849b-46fe-b2c9-f19fab8a7d0e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:38.165522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:38.166148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:38.166433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:38.166720 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:38.167408 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:38.169089 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37742ebc-9655-4ca6-9ac3-6cc64a2196ad admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:38.179737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1374/2742] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:38 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:38.184890 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:38.200910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9871359-a92c-405b-8380-2986e5f7b1b1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:38.208260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:38.209452 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:38.209726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:38.209998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] PATH_INFO: `/v3/projects/66808171b82e49c28e3a25f96351a7ec/users/1477b202510347dbbebcb66139cee153/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:38.212075 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66808171b82e49c28e3a25f96351a7ec, user_id=1477b202510347dbbebcb66139cee153, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:38.214910 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:38.226174 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1369/2743] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:38 2021] PUT /identity/v3/projects/66808171b82e49c28e3a25f96351a7ec/users/1477b202510347dbbebcb66139cee153/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:38.236513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:38.237020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:38.237352 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:38.278947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] MFA Rules not processed for user `1477b202510347dbbebcb66139cee153`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:38.280758 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:38.371805 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1375/2744] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:38 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:38.383637 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:38.386668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:38.462258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c5416-216f-4402-ab4e-9806e5007213 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:38.466289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:38.466884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:38.467166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:38.467448 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:38.477914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:38.480449 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:38.492205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1370/2745] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:38 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:39.053404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:39.055001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:39.068255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1b70-4562-43fa-9eba-cae731c1e948 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:39.072683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:39.073270 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:39.073556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:39.073834 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:39.146906 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:39.148294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:39.157506 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1376/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:39 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:43.890840 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:43.899871 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24747615-675a-4e53-a5a5-2b51bb964ad7 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:43.903592 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:43.904162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:43.904475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:43.904757 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:43.971417 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:43.973084 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bffab1-259b-4d3b-aaf7-8473a2d00c5b service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:43.982844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1371/2747] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:43 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:46.577283 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:46.757106 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca727-ad5f-4d88-b7bb-2205abeac3ff service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:46.762225 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:46.763034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:46.763323 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:46.763569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] PATH_INFO: `/v3/users/9444faf676ba44be82bbd4db2b518494` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:46.764815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9444faf676ba44be82bbd4db2b518494)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:46.766752 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:46.826594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9444faf676ba44be82bbd4db2b518494'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:46.834499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9444faf676ba44be82bbd4db2b518494'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:46.846800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9444faf676ba44be82bbd4db2b518494'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:46.847486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9444faf676ba44be82bbd4db2b518494'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:46.848117 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9444faf676ba44be82bbd4db2b518494'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:46.861583 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1377/2748] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:46 2021] DELETE /identity/v3/users/9444faf676ba44be82bbd4db2b518494 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:46.866429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:46.866887 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:46.867030 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:46.889589 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:46.890773 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:46.962480 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1372/2749] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:46.976399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:46.978189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:47.047682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ee35-e4a4-4e2e-aa04-7c37014d306a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:47.052111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:47.053123 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:47.053576 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:47.053974 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:47.069359 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:47.071557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:47.086044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1378/2750] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:47.465868 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:47.467267 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:47.478900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d17bf-09cc-4672-87b7-c9c92f07665d None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:47.483768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:47.484606 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:47.484891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:47.485168 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] PATH_INFO: `/v3/projects/19e90cdcf6ba4460a09738a4a310516d` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:47.486284 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e90cdcf6ba4460a09738a4a310516d)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:47.488182 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:47.544382 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e90cdcf6ba4460a09738a4a310516d', 'request_id': 'req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.552819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e90cdcf6ba4460a09738a4a310516d', 'request_id': 'req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.564195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e90cdcf6ba4460a09738a4a310516d', 'request_id': 'req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.575087 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] The token cache is being invalidate because project 19e90cdcf6ba4460a09738a4a310516d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:47.575366 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.576106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.577641 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1373/2751] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:47 2021] DELETE /identity/v3/projects/19e90cdcf6ba4460a09738a4a310516d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:47.581998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:47.592258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e31df-1589-4c7a-8771-f2829efd9c5b service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:47.660893 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:47.661609 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:47.661895 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:47.662176 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] PATH_INFO: `/v3/users/d0555f448e794e6888bfb1b608b88c33` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:47.663608 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0555f448e794e6888bfb1b608b88c33)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:47.665593 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:47.715673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0555f448e794e6888bfb1b608b88c33'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.724029 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0555f448e794e6888bfb1b608b88c33'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.735922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0555f448e794e6888bfb1b608b88c33'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.736570 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0555f448e794e6888bfb1b608b88c33'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.737152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0555f448e794e6888bfb1b608b88c33'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:47.749856 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1379/2752] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:47 2021] DELETE /identity/v3/users/d0555f448e794e6888bfb1b608b88c33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:48.120422 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:48.121904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:48.134309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661c1f7-17a6-422c-b0ec-bffe1c0b67fd admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:48.202987 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:48.203738 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:48.204089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:48.204483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] PATH_INFO: `/v3/projects/aa6274e79c3b4914915eb58e1f1bf4b0` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:48.206567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6274e79c3b4914915eb58e1f1bf4b0)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:48.209900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:48.269053 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6274e79c3b4914915eb58e1f1bf4b0', 'request_id': 'req-e6a8e702-7dad-4510-bd21-99020de73669'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.278882 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6274e79c3b4914915eb58e1f1bf4b0', 'request_id': 'req-e6a8e702-7dad-4510-bd21-99020de73669'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.293704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6274e79c3b4914915eb58e1f1bf4b0', 'request_id': 'req-e6a8e702-7dad-4510-bd21-99020de73669'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.304341 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] The token cache is being invalidate because project aa6274e79c3b4914915eb58e1f1bf4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:48.304633 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.305269 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.306765 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1374/2753] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:48 2021] DELETE /identity/v3/projects/aa6274e79c3b4914915eb58e1f1bf4b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:48.310816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:48.312387 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:48.324925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429831e-c673-4507-ac05-5cbd1208642b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:48.400655 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:48.401483 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:48.401771 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:48.402055 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] PATH_INFO: `/v3/users/1477b202510347dbbebcb66139cee153` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:48.403306 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1477b202510347dbbebcb66139cee153)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:48.405287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:48.463027 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1477b202510347dbbebcb66139cee153'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.471816 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1477b202510347dbbebcb66139cee153'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.483617 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1477b202510347dbbebcb66139cee153'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.484265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1477b202510347dbbebcb66139cee153'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.484927 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-1ebca278-d1c3-4a6f-a3a9-e96927a99105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1477b202510347dbbebcb66139cee153'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:48.498618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1380/2754] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:48 2021] DELETE /identity/v3/users/1477b202510347dbbebcb66139cee153 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:48.982528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:48.984015 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:48.999536 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e702-7dad-4510-bd21-99020de73669 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.064578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.065353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.065635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.065911 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] PATH_INFO: `/v3/projects/66808171b82e49c28e3a25f96351a7ec` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.067076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66808171b82e49c28e3a25f96351a7ec)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.069104 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.127056 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66808171b82e49c28e3a25f96351a7ec', 'request_id': 'req-7c9343da-baca-4e14-80f1-6d4494129712'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:49.137799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66808171b82e49c28e3a25f96351a7ec', 'request_id': 'req-7c9343da-baca-4e14-80f1-6d4494129712'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:49.149747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66808171b82e49c28e3a25f96351a7ec', 'request_id': 'req-7c9343da-baca-4e14-80f1-6d4494129712'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:49.159553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] The token cache is being invalidate because project 66808171b82e49c28e3a25f96351a7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:49.159835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:49.160477 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-7c9343da-baca-4e14-80f1-6d4494129712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:49.161936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1375/2755] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:48 2021] DELETE /identity/v3/projects/66808171b82e49c28e3a25f96351a7ec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:49.169902 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.170428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.170520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.195809 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:49.196993 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:49.276950 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1381/2756] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:49.285343 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.285664 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.285940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.308821 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:49.309968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:49.317998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1376/2757] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:49.325955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.336830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fed1a-dbc4-4918-8db1-df21af405af4 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.342910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.343496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.343774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.344044 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.344760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:47:49.345051 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.346645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.359727 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1382/2758] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:47:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:47:49.365268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.375079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd670-d58e-442d-a651-84874f629c2f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.380857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.381433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.381753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.382033 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.382665 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.384662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.420093 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1377/2759] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:49.424127 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.434315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbde943-d73e-4387-b367-c2c6f4d33970 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.500169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.500812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.501076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.501344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.501956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.503858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.534303 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1383/2760] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:49.539031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.549359 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1720fd4-db31-4fa1-86e6-7542859fc143 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.554167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.554749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.555028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.555303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.555989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.557629 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.567755 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1378/2761] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:49.572431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.582342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08110f54-4d38-472c-9f8d-784a2ff56433 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.587749 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.588378 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.588664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.588945 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.589709 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.591311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6d5ab-574e-4d92-86af-00505b094924 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.601850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1384/2762] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:49.607869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.622831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07f10-0710-4e00-b5be-386d4c0f3b33 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.630616 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.631556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.631847 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.632127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] PATH_INFO: `/v3/projects/bf07422c391e441984dba3e5c1754a57/users/1d14f97fff654d26b6ca2e9b0de69b34/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.653236 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf07422c391e441984dba3e5c1754a57, user_id=1d14f97fff654d26b6ca2e9b0de69b34, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.655942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.672162 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1379/2763] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:49 2021] PUT /identity/v3/projects/bf07422c391e441984dba3e5c1754a57/users/1d14f97fff654d26b6ca2e9b0de69b34/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:49.685486 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.685782 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.686056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.726179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] MFA Rules not processed for user `1d14f97fff654d26b6ca2e9b0de69b34`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:49.727338 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:49.812365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1385/2764] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:47:49.817037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.893138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb50aa-e45d-4516-a628-779ac67fa4c0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:49.898772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:49.899378 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:49.899658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:49.899950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:49.900611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:49.902502 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:49.931767 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1380/2765] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:49.936063 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:49.946869 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e961d-3f39-4a05-b18f-0ca3580d8ffe None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.019928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.020838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.021141 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.021496 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.022299 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.024339 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.052438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1386/2766] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:49 2021] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:50.058290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.075826 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ac8d-fb43-4328-9e8e-0bfbaa2a83da admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.084317 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.085275 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.085545 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.085820 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.086556 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.088195 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.100919 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1381/2767] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:50 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:47:50.107612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.121405 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787c1b-ef0d-454d-921a-e84071f9e56b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.127279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.128129 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.128440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.128730 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] PATH_INFO: `/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c/users/f604be6096b44fde8120b3fa1734827e/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.150793 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4d4e3ce6c24ff4b19121ba41e3360c, user_id=f604be6096b44fde8120b3fa1734827e, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.153526 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.169079 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1387/2768] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:50 2021] PUT /identity/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c/users/f604be6096b44fde8120b3fa1734827e/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:50.173224 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.183210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becc358-0972-4236-a40e-3ce712d60146 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.258907 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.259499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.259803 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.260069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.260816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.262376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28183c84-07a3-4a0f-855c-82b4a5dad5a6 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.273042 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1382/2769] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:50 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:50.277590 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.288845 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874db-ccb5-4110-bbb0-218f51b38d22 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.294488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.295311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.295594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.295877 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] PATH_INFO: `/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c/users/f604be6096b44fde8120b3fa1734827e/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.297852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4d4e3ce6c24ff4b19121ba41e3360c, user_id=f604be6096b44fde8120b3fa1734827e, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.300516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.311484 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1388/2770] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:50 2021] PUT /identity/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c/users/f604be6096b44fde8120b3fa1734827e/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:50.321966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.322261 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.322507 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.360957 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] MFA Rules not processed for user `f604be6096b44fde8120b3fa1734827e`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:50.362038 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:50.456499 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1383/2771] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:50 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:50.469331 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.471381 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:50.553700 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb30d-034d-469d-9363-18ac0cf792a0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.557646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.558227 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.558516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.558797 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.567942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.569469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.580870 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1389/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:50 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:50.718383 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:50.728818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70044-d4de-4123-8bf1-0f531e918291 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:50.733139 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:50.733714 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:50.734024 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:50.734291 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:50.814505 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:50.815936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c62d4e-8b5a-47c0-acc2-c8ddfd120105 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:50.824970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1384/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:50 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:56.435183 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:56.506436 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a4009-a433-4b25-ad29-8d4ddc4eb35c service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:56.511800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:56.512664 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:56.512959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:56.513231 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] PATH_INFO: `/v3/users/1d14f97fff654d26b6ca2e9b0de69b34` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:56.514389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d14f97fff654d26b6ca2e9b0de69b34)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:56.516434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:56.571374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d14f97fff654d26b6ca2e9b0de69b34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:56.580034 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d14f97fff654d26b6ca2e9b0de69b34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:56.593203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d14f97fff654d26b6ca2e9b0de69b34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:56.593898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d14f97fff654d26b6ca2e9b0de69b34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:56.594561 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d14f97fff654d26b6ca2e9b0de69b34'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:56.608690 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1390/2774] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:56 2021] DELETE /identity/v3/users/1d14f97fff654d26b6ca2e9b0de69b34 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:56.614660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:56.615138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:56.615228 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:56.638451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:56.639600 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:56.711652 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:56.713716 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:56.717219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1385/2775] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:47:56.727986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:56.729390 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:56.796014 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93602646-70ad-49a8-a1f3-a5d4017f5e6b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:56.799139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5623a5-7633-4d52-89b2-c35527235b37 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:56.805351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:56.806042 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:56.806327 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:56.806647 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:56.807196 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:56.807968 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:56.808344 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:56.808683 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:56.808781 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:56.819113 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:56.820650 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:56.820762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:56.822403 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:56.831297 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1386/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 13:47:56.832462 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1391/2777] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:56 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:57.209370 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:57.211012 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:57.224019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd26a4-47c8-46f2-aac0-09bbb8c741a1 service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:57.229504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:57.230286 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:57.230564 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:57.230837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] PATH_INFO: `/v3/projects/bf07422c391e441984dba3e5c1754a57` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:57.232051 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf07422c391e441984dba3e5c1754a57)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:57.234019 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:57.296406 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf07422c391e441984dba3e5c1754a57', 'request_id': 'req-a058ece1-11a9-4aea-b24f-e4775115cc81'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.307296 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf07422c391e441984dba3e5c1754a57', 'request_id': 'req-a058ece1-11a9-4aea-b24f-e4775115cc81'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.318264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf07422c391e441984dba3e5c1754a57', 'request_id': 'req-a058ece1-11a9-4aea-b24f-e4775115cc81'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.327988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] The token cache is being invalidate because project bf07422c391e441984dba3e5c1754a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:57.328271 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.328963 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.330469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1387/2778] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:57 2021] DELETE /identity/v3/projects/bf07422c391e441984dba3e5c1754a57 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:57.335189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:57.346211 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05fe23-4a6a-4877-9446-71e0ff70851f service placement] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:57.434890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:57.435689 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:57.436320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:57.436320 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] PATH_INFO: `/v3/users/f604be6096b44fde8120b3fa1734827e` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:57.437440 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f604be6096b44fde8120b3fa1734827e)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:57.439449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:57.502311 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f604be6096b44fde8120b3fa1734827e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.511317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f604be6096b44fde8120b3fa1734827e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.523639 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f604be6096b44fde8120b3fa1734827e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.524355 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f604be6096b44fde8120b3fa1734827e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.525073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d364b872-1df0-401a-8999-b6f6e8e5d322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f604be6096b44fde8120b3fa1734827e'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:57.537861 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1392/2779] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:47:57 2021] DELETE /identity/v3/users/f604be6096b44fde8120b3fa1734827e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:57.939789 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:57.941800 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:57.954819 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ece1-11a9-4aea-b24f-e4775115cc81 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.023698 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.024526 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.024810 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.025092 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] PATH_INFO: `/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.026265 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4d4e3ce6c24ff4b19121ba41e3360c)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.028180 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.082127 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4d4e3ce6c24ff4b19121ba41e3360c', 'request_id': 'req-2ef8a7ee-4e1e-4636-98da-97803b443cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:58.091303 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4d4e3ce6c24ff4b19121ba41e3360c', 'request_id': 'req-2ef8a7ee-4e1e-4636-98da-97803b443cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:58.103176 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4d4e3ce6c24ff4b19121ba41e3360c', 'request_id': 'req-2ef8a7ee-4e1e-4636-98da-97803b443cfb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:58.114989 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] The token cache is being invalidate because project fb4d4e3ce6c24ff4b19121ba41e3360c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:47:58.115389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:58.116356 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-2ef8a7ee-4e1e-4636-98da-97803b443cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:47:58.118076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1388/2780] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:47:57 2021] DELETE /identity/v3/projects/fb4d4e3ce6c24ff4b19121ba41e3360c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:58.127341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.127815 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.128294 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.154656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:58.155806 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:58.223680 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1393/2781] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:58.237648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.237934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.238213 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.262537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:58.263671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:58.271604 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1389/2782] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:47:58.276159 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.285630 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2040a-2a3d-4669-a0d2-7d00f0f01d1a None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.290383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.291008 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.291288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.291557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.292264 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:47:58.292562 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.294148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.306661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1394/2783] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:47:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:47:58.311156 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.320732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302fa35-d0d1-4114-8ca3-a86516dc5fc3 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.325906 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.326575 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.326862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.327136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.327788 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.329728 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.363397 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1390/2784] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:58.367637 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.377956 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c639dba-c8db-4bf2-9458-323a214b85b5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.443522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.444280 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.444447 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.444721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.445358 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.447267 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.473941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1395/2785] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:58.522185 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.533407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990efd-d36a-4506-92df-bc2d570c14e1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.541177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.541774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.542057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.542335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.543031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.544727 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.555434 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1391/2786] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:58.560808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.575168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f712ea-9d1c-46bf-902a-8e02553625a7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.580994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.581638 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.581922 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.582214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.582911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.584898 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fac18-cd74-46a1-85c9-3c6586e2ffcc admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.595676 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1396/2787] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:58.599985 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.610028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32827-3c1c-45fb-9ec8-b0f4fa5b1896 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.614644 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.615418 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.615706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.615988 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] PATH_INFO: `/v3/projects/d8219d51cdfb4683abc708bf51726e08/users/4ded5dcd5c744415ba71f062fdf377c6/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.640290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8219d51cdfb4683abc708bf51726e08, user_id=4ded5dcd5c744415ba71f062fdf377c6, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.640290 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.659914 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1392/2788] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:58 2021] PUT /identity/v3/projects/d8219d51cdfb4683abc708bf51726e08/users/4ded5dcd5c744415ba71f062fdf377c6/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:47:58.671269 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.671554 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.671839 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.709841 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] MFA Rules not processed for user `4ded5dcd5c744415ba71f062fdf377c6`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:58.711002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:58.794287 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1397/2789] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:58.799043 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.871610 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d7351-d6f6-496e-90df-be120d95e30f admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.877114 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.877713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.878005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.878266 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.878912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.880891 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:58.915824 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1393/2790] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:47:58.920357 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:58.932265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe4a10-ea89-46b3-92c9-20dfc9ac0037 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:58.995581 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:58.996179 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:58.996504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:58.996785 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:58.997432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:58.999342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.023344 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1398/2791] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:47:58 2021] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:47:59.027875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.038669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d5e7-7b3d-4258-abaa-ca155d1a8e9e admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.043762 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.044376 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.044661 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.044937 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.045647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.047203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.058327 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1394/2792] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:59.062712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.072767 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ce01-e1c3-4e2b-80bd-80534b21daa8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.077407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.078223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.078504 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.078780 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] PATH_INFO: `/v3/projects/c6b3c6253450447eba4d77641e72f263/users/c712981a7598417fabd5aa1b92e89f84/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.099847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b3c6253450447eba4d77641e72f263, user_id=c712981a7598417fabd5aa1b92e89f84, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.102511 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.120671 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1399/2793] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:59 2021] PUT /identity/v3/projects/c6b3c6253450447eba4d77641e72f263/users/c712981a7598417fabd5aa1b92e89f84/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:59.124997 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.134768 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6258493-e8c1-407e-a0f6-5a67668a18b9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.200774 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.201346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.201632 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.201912 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.202648 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.204246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546da5cd-07ab-4e4e-b5b8-078c358c4601 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.215498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1395/2794] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:47:59 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:47:59.222452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.233475 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265202-4d96-4432-9ad2-843947aec135 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.239369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.240196 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.240519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.240798 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] PATH_INFO: `/v3/projects/c6b3c6253450447eba4d77641e72f263/users/c712981a7598417fabd5aa1b92e89f84/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.242939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b3c6253450447eba4d77641e72f263, user_id=c712981a7598417fabd5aa1b92e89f84, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.245930 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.257000 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1400/2795] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:47:59 2021] PUT /identity/v3/projects/c6b3c6253450447eba4d77641e72f263/users/c712981a7598417fabd5aa1b92e89f84/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:47:59.267207 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.267486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.267760 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.305144 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] MFA Rules not processed for user `c712981a7598417fabd5aa1b92e89f84`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:47:59.306457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:59.388594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1396/2796] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:47:59 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:47:59.399342 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.402994 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:47:59.484025 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c540d2-b19d-4937-9830-a8f6bf48d4e7 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.491085 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.491903 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.492329 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.492792 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.508279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.510251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.519683 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1401/2797] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:59 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:47:59.630884 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:47:59.641067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a93c4-b254-4d97-a9c5-d97ca7495d65 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:47:59.644761 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:47:59.645380 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:47:59.645620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:47:59.645897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:47:59.710658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:47:59.712116 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e816-59be-4d04-96c4-8b483b00278e service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:47:59.720956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1397/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:47:59 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:00.113642 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:00.187448 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c2d2-4044-4b5e-a451-22f1c5286c99 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:00.192975 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:00.193820 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:00.194119 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:00.194399 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] PATH_INFO: `/v3/users/4ded5dcd5c744415ba71f062fdf377c6` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:00.195625 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ded5dcd5c744415ba71f062fdf377c6)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:00.197979 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:00.259760 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ded5dcd5c744415ba71f062fdf377c6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:00.267732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ded5dcd5c744415ba71f062fdf377c6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:00.284433 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ded5dcd5c744415ba71f062fdf377c6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:00.285096 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ded5dcd5c744415ba71f062fdf377c6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:00.285693 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ded5dcd5c744415ba71f062fdf377c6'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:00.299670 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1402/2799] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:00 2021] DELETE /identity/v3/users/4ded5dcd5c744415ba71f062fdf377c6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:00.304561 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:00.305081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:00.305081 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:00.327934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:00.329173 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:00.407956 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1398/2800] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:00.418847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:00.420297 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:00.484423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced6c2f-8f81-4318-b75b-c619c2516e86 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:00.488569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:00.489146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:00.489431 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:00.489721 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:00.499232 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:00.500718 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:00.509873 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1403/2801] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:00.924475 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:00.926085 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:00.937993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31a4f-675b-4ef7-8eaa-0fc23fb71d1f None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:00.943346 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:00.944149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:00.944464 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:00.944739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] PATH_INFO: `/v3/projects/d8219d51cdfb4683abc708bf51726e08` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:00.946011 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8219d51cdfb4683abc708bf51726e08)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:00.948219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:01.005521 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8219d51cdfb4683abc708bf51726e08', 'request_id': 'req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.016574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8219d51cdfb4683abc708bf51726e08', 'request_id': 'req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.028068 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8219d51cdfb4683abc708bf51726e08', 'request_id': 'req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.039429 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] The token cache is being invalidate because project d8219d51cdfb4683abc708bf51726e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:01.039802 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.040856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.042732 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1399/2802] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:00 2021] DELETE /identity/v3/projects/d8219d51cdfb4683abc708bf51726e08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:01.047052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:01.057469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b30af-6c11-4c24-9d62-c567eb428d7d service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:01.138969 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:01.140064 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:01.140634 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:01.141007 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] PATH_INFO: `/v3/users/c712981a7598417fabd5aa1b92e89f84` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:01.142961 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c712981a7598417fabd5aa1b92e89f84)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:01.146173 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:01.200737 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c712981a7598417fabd5aa1b92e89f84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.209293 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c712981a7598417fabd5aa1b92e89f84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.221429 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c712981a7598417fabd5aa1b92e89f84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.222145 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c712981a7598417fabd5aa1b92e89f84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.222852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-63e5971f-3fa5-4085-9125-9d4e279ded79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c712981a7598417fabd5aa1b92e89f84'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.236835 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1404/2803] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:01 2021] DELETE /identity/v3/users/c712981a7598417fabd5aa1b92e89f84 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:48:01.628932 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:01.630433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:01.643537 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8eb90-51fd-4410-850b-dfcb19a6cde0 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:01.715433 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:01.716255 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:01.716554 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:01.716857 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] PATH_INFO: `/v3/projects/c6b3c6253450447eba4d77641e72f263` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:01.717986 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b3c6253450447eba4d77641e72f263)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:01.720028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:01.787818 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b3c6253450447eba4d77641e72f263', 'request_id': 'req-21ed6c2f-9364-43c6-9b05-fb551d3b926e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.797235 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b3c6253450447eba4d77641e72f263', 'request_id': 'req-21ed6c2f-9364-43c6-9b05-fb551d3b926e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.808875 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b3c6253450447eba4d77641e72f263', 'request_id': 'req-21ed6c2f-9364-43c6-9b05-fb551d3b926e'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.819385 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] The token cache is being invalidate because project c6b3c6253450447eba4d77641e72f263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:01.819699 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.820410 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-21ed6c2f-9364-43c6-9b05-fb551d3b926e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:01.822083 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1400/2804] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:01 2021] DELETE /identity/v3/projects/c6b3c6253450447eba4d77641e72f263 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:01.828420 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:01.828908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:01.828982 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:01.853488 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:01.854725 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:01.926160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1405/2805] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:01.936753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:01.937115 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:01.937491 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:01.972386 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:01.974106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:01.984157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1401/2806] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:01.990567 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.001684 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae1830-3a41-4ff3-bb91-f98a153a0bbb None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.007550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.008326 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.008596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.008871 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.009612 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:48:02.009900 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.011525 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.025002 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1406/2807] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:48:02.029549 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.038883 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0871f-9592-42c5-9a0d-1eebd9679d13 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.044646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.045218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.045508 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.045782 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.046555 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.049436 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.089607 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1402/2808] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:02.094163 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.104947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae97b78-dd2d-417f-85c4-6a2f91320a56 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.182543 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.183169 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.183449 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.183735 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.184385 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.186284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.208088 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1407/2809] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:02.213432 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.223855 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa6cf-f2ce-4229-a741-b553db1c45cc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.228363 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.228970 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.229217 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.229542 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.230204 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.231799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.241849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1403/2810] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:02.246139 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.256284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcaaa2-560a-478d-bc34-a986e11f6d8e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.261317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.261911 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.262190 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.262469 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.263152 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.264814 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab330-373e-4065-ae24-8f135af5d929 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.276146 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1408/2811] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:02.280494 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.290892 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd2b3-d487-4e25-b45d-e6dfa68d0fa2 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.295326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.296118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.296431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.296706 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] PATH_INFO: `/v3/projects/70d35081c30347e582746533f323c909/users/9d6ca4bb2cc04b84b701a72c629ec6fb/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.316065 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d35081c30347e582746533f323c909, user_id=9d6ca4bb2cc04b84b701a72c629ec6fb, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.318734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.334877 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1404/2812] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:02 2021] PUT /identity/v3/projects/70d35081c30347e582746533f323c909/users/9d6ca4bb2cc04b84b701a72c629ec6fb/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:02.345427 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.345739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.346056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.384124 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] MFA Rules not processed for user `9d6ca4bb2cc04b84b701a72c629ec6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:02.385467 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:02.465195 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1409/2813] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:02.470199 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.547799 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caaa38-a4f2-45b4-8585-374ca457ecbc admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.554250 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.554863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.555146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.555426 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.556054 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.558041 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.589658 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1405/2814] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:02.594066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.605052 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada632c4-b10e-4551-9f78-265cb9e8aca9 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.668904 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.669513 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.669802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.670084 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.670702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.672640 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.691618 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1410/2815] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:02.696112 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.706515 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c424-0bf0-417c-9db9-9837bd5c39e5 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.712501 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.713233 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.713750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.714230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.715076 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.716746 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.729111 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1406/2816] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:48:02.733417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.743369 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe02ef-2b77-403d-9e0b-6a1370e4561b admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.748821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.749456 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.749731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.750011 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.750703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.752336 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876c0b1-4334-4f74-bf4f-d6db1a641253 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.763391 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1411/2817] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:48:02.768478 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:02.781252 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de77c-8c1d-481f-9b3c-155d029ba4a4 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:02.786581 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:02.787389 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.787668 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.787942 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] PATH_INFO: `/v3/projects/7a8b2b17004d4261a35e56240996b8be/users/5a3b8b739939442b8807ec67d35caf18/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.808045 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8b2b17004d4261a35e56240996b8be, user_id=5a3b8b739939442b8807ec67d35caf18, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:02.810704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:02.825718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1407/2818] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:02 2021] PUT /identity/v3/projects/7a8b2b17004d4261a35e56240996b8be/users/5a3b8b739939442b8807ec67d35caf18/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:02.837340 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:02.837858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:02.838033 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:02.876093 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] MFA Rules not processed for user `5a3b8b739939442b8807ec67d35caf18`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:02.877301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:02.953556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1412/2819] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:02.959177 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.042209 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905845b8-3807-45ef-b944-9c67c1882963 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.046844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.047435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.047718 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.047998 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.048697 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.050620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.087073 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1408/2820] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:02 2021] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:03.091830 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.103001 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ef4d9-9a55-4a57-b980-c061da0f0fae None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.184977 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.185579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.185838 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.186136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.186789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.188697 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.215915 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1413/2821] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:03 2021] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:48:03.220828 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.234688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74660-d235-4f0a-81b4-888bf4fa2ff1 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.239704 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.240329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.240617 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.240898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.241594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.243190 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.254149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1409/2822] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:03.258742 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.269083 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712177-52e9-435b-b3b6-8fb28dcdc5bb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.274789 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.275615 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.275925 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.276203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] PATH_INFO: `/v3/projects/807c01830b544408ad52a0cbace5a2d3/users/fdfc8cce80fb486ab8f930e5cdd17576/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.297284 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807c01830b544408ad52a0cbace5a2d3, user_id=fdfc8cce80fb486ab8f930e5cdd17576, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.301691 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.317499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1414/2823] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:03 2021] PUT /identity/v3/projects/807c01830b544408ad52a0cbace5a2d3/users/fdfc8cce80fb486ab8f930e5cdd17576/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:03.322234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.336527 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0278d0-f6f8-45a0-a2ad-6c867bca0191 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.404420 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.406282 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.406678 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.407057 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.408467 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.411069 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424991c-760d-49fb-a8bf-29962377f740 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.429046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1410/2824] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:03.436499 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.452220 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3bfd3-59a2-428e-b7f2-25c2f4033a42 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.461301 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.462569 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.462949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.463309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] PATH_INFO: `/v3/projects/807c01830b544408ad52a0cbace5a2d3/users/fdfc8cce80fb486ab8f930e5cdd17576/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.465632 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807c01830b544408ad52a0cbace5a2d3, user_id=fdfc8cce80fb486ab8f930e5cdd17576, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.468379 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.479821 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1415/2825] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:03 2021] PUT /identity/v3/projects/807c01830b544408ad52a0cbace5a2d3/users/fdfc8cce80fb486ab8f930e5cdd17576/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:48:03.490394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.490689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.490979 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.527812 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] MFA Rules not processed for user `fdfc8cce80fb486ab8f930e5cdd17576`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:03.529032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:03.607028 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1411/2826] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:03 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:03.619739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:03.621949 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:03.690681 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b707ca2-b9a1-41b6-9543-fb1c83b375e0 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:03.694796 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:03.695404 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:03.695699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:03.695980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:03.762538 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:03.763972 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:03.772784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1416/2827] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:03 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:05.577246 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:05.579453 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:05.595157 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404788ce-adbb-4bdb-950b-9fd62c8e7ea2 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:05.600026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:05.600646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:05.600934 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:05.601208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:05.670636 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:05.672080 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:05.681326 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1412/2828] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:05 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:06.506255 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:06.515896 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf9cda-c078-4027-902c-cb6886594848 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:06.520271 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:06.520882 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:06.521168 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:06.521445 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:06.530704 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:06.532189 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c7a25-2792-4a79-9e83-59afd547ee42 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:06.541307 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1417/2829] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:06 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:11.148603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:11.249660 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9436-63c9-432e-8bef-15af84a3e362 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:11.255353 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:11.256148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:11.256466 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:11.256750 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] PATH_INFO: `/v3/users/9d6ca4bb2cc04b84b701a72c629ec6fb` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:11.258096 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6ca4bb2cc04b84b701a72c629ec6fb)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:11.260004 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:11.319369 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6ca4bb2cc04b84b701a72c629ec6fb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:11.329154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6ca4bb2cc04b84b701a72c629ec6fb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:11.342866 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6ca4bb2cc04b84b701a72c629ec6fb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:11.343528 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6ca4bb2cc04b84b701a72c629ec6fb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:11.344138 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6ca4bb2cc04b84b701a72c629ec6fb'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:11.358137 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1413/2830] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:11 2021] DELETE /identity/v3/users/9d6ca4bb2cc04b84b701a72c629ec6fb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:11.364009 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:11.364741 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:11.365047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:11.410137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:11.411309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:11.483193 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1418/2831] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:11.500900 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:11.503128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:11.619621 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445317-6916-4e2f-a99d-275d5258ca8b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:11.623614 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:11.624193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:11.624509 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:11.624793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:11.639721 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:11.642032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:11.651666 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1414/2832] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:12.039986 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:12.041596 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:12.053696 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907861d-2ee6-4917-b13c-9b7403a15843 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:12.059020 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:12.059810 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:12.060091 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:12.060401 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] PATH_INFO: `/v3/projects/70d35081c30347e582746533f323c909` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:12.061589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d35081c30347e582746533f323c909)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:12.063522 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:12.116908 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d35081c30347e582746533f323c909', 'request_id': 'req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.125507 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d35081c30347e582746533f323c909', 'request_id': 'req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.136932 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d35081c30347e582746533f323c909', 'request_id': 'req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.146978 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] The token cache is being invalidate because project 70d35081c30347e582746533f323c909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:12.147251 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.147884 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.149438 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1419/2833] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:12 2021] DELETE /identity/v3/projects/70d35081c30347e582746533f323c909 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:12.153611 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:12.163171 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07e86-126b-4ba5-ad4a-982dac55d5aa service neutron] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:12.237715 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:12.238567 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:12.238837 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:12.239106 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] PATH_INFO: `/v3/users/5a3b8b739939442b8807ec67d35caf18` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:12.240483 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3b8b739939442b8807ec67d35caf18)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:12.242416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:12.292375 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3b8b739939442b8807ec67d35caf18'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.301010 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3b8b739939442b8807ec67d35caf18'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.320009 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3b8b739939442b8807ec67d35caf18'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.321146 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3b8b739939442b8807ec67d35caf18'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.322167 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3b8b739939442b8807ec67d35caf18'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.339587 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1415/2834] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:12 2021] DELETE /identity/v3/users/5a3b8b739939442b8807ec67d35caf18 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:12.718981 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:12.720673 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:12.734761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2abd-976d-4c3f-ad3b-7144369f9a71 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:12.801761 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:12.802489 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:12.802774 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:12.803054 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] PATH_INFO: `/v3/projects/7a8b2b17004d4261a35e56240996b8be` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:12.804156 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8b2b17004d4261a35e56240996b8be)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:12.806080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:12.859144 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8b2b17004d4261a35e56240996b8be', 'request_id': 'req-d876d52f-a416-4259-b7fe-97f42c78abad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.867829 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8b2b17004d4261a35e56240996b8be', 'request_id': 'req-d876d52f-a416-4259-b7fe-97f42c78abad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.880744 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8b2b17004d4261a35e56240996b8be', 'request_id': 'req-d876d52f-a416-4259-b7fe-97f42c78abad'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.890788 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] The token cache is being invalidate because project 7a8b2b17004d4261a35e56240996b8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:12.891068 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.891707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:12.893259 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1420/2835] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:12 2021] DELETE /identity/v3/projects/7a8b2b17004d4261a35e56240996b8be => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:12.897608 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:12.899094 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:12.918451 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04874ee-8453-423a-aec9-10f1a3ac9f85 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:12.982832 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:12.983646 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:12.983927 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:12.984203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] PATH_INFO: `/v3/users/fdfc8cce80fb486ab8f930e5cdd17576` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:12.985460 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfc8cce80fb486ab8f930e5cdd17576)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:12.987414 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:13.049626 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfc8cce80fb486ab8f930e5cdd17576'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.058594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfc8cce80fb486ab8f930e5cdd17576'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.071244 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfc8cce80fb486ab8f930e5cdd17576'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.071980 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfc8cce80fb486ab8f930e5cdd17576'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.072680 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-e77766e1-41a9-48f5-b3a9-ef1660937f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfc8cce80fb486ab8f930e5cdd17576'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.086856 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1416/2836] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:12 2021] DELETE /identity/v3/users/fdfc8cce80fb486ab8f930e5cdd17576 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:13.512679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:13.514847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:13.541372 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d52f-a416-4259-b7fe-97f42c78abad admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:13.622191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:13.622999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:13.623290 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:13.623573 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] PATH_INFO: `/v3/projects/807c01830b544408ad52a0cbace5a2d3` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:13.624811 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807c01830b544408ad52a0cbace5a2d3)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:13.626751 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:13.681208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807c01830b544408ad52a0cbace5a2d3', 'request_id': 'req-792a52e7-9608-44d0-ab57-b19eb3b40839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.691263 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807c01830b544408ad52a0cbace5a2d3', 'request_id': 'req-792a52e7-9608-44d0-ab57-b19eb3b40839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.702627 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807c01830b544408ad52a0cbace5a2d3', 'request_id': 'req-792a52e7-9608-44d0-ab57-b19eb3b40839'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.713285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] The token cache is being invalidate because project 807c01830b544408ad52a0cbace5a2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:13.713564 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.714365 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-792a52e7-9608-44d0-ab57-b19eb3b40839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:13.715852 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1421/2837] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:13 2021] DELETE /identity/v3/projects/807c01830b544408ad52a0cbace5a2d3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:13.722118 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:13.722624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:13.722751 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:13.746551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:13.747741 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:13.828031 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1417/2838] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:13.836646 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:13.837147 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:13.837237 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:13.862454 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:13.863605 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:13.871492 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1422/2839] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:13.876525 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:13.886334 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e578b2-4e63-42a9-8943-c5ab785ae081 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:13.891662 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:13.892264 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:13.892557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:13.892835 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] PATH_INFO: `/v3/domains` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:13.893557 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:48:13.893853 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:13.895504 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:13.908208 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1418/2840] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:48:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:48:13.912645 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:13.921746 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09101649-f14b-4bca-86e3-8d5ea5feaf49 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:13.927285 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:13.927916 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:13.928200 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:13.928519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:13.929198 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:13.931113 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:13.960406 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1423/2841] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:13 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:48:13.964711 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:13.974961 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e7df-7c99-401f-b823-2ae6f3944364 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.038734 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.039345 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.039635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.039925 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.040622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.042570 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.067578 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1419/2842] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:13 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:48:14.072043 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.082692 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b245d2c-cc0f-425a-85d0-1f86a87cde0f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.087666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.088223 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.088679 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.089056 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.090010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.091674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.102779 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1424/2843] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:14.107309 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.117492 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0c16f-6a0a-4b94-b757-e89e2d8813ab admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.123315 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.123904 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.124175 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.124479 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.125210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.127049 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d936c-59ce-41b4-a1b4-8de23a71a87e admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.138463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1420/2844] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:14.142868 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.153317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf726af-05fd-4a35-bf57-70a5ec46fcdb admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.159726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.160574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.160858 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.161136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] PATH_INFO: `/v3/projects/e1c9230cccf24d3fa2ad34025e3737aa/users/accbe32c400f412e8f9a765bc19a4b2f/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.181941 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c9230cccf24d3fa2ad34025e3737aa, user_id=accbe32c400f412e8f9a765bc19a4b2f, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.184653 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.202214 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1425/2845] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:14 2021] PUT /identity/v3/projects/e1c9230cccf24d3fa2ad34025e3737aa/users/accbe32c400f412e8f9a765bc19a4b2f/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:14.218553 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.218841 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.219117 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.257833 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] MFA Rules not processed for user `accbe32c400f412e8f9a765bc19a4b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:14.258993 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:14.345046 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1421/2846] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:14.350547 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.433235 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062108d9-d4e3-4456-9af4-1d22bde1d72f admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.439442 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.440136 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.440458 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.440739 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.441434 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.443482 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.475345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1426/2847] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:48:14.480700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.494700 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304310b-6ac8-4a31-999f-6f47f3c36313 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.564193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.564908 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.565205 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.565486 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.566145 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.568210 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.591624 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1422/2848] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:14.595991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.607578 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e25c-be10-46fd-ae14-b7d5ee2694f8 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.612899 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.613518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.613812 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.614208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.614890 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.616516 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.627250 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1427/2849] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:14.631780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.641778 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6563-6478-445a-b9a6-a927d2ffd030 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.646753 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.647285 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.647571 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.647849 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.648566 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.650136 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67543d08-041b-4848-93f4-bfc1f7b114f7 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.661219 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1423/2850] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:14.669279 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.685389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e32-7f12-46f4-b3be-bee2f2f13b3e admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.691453 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.693035 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.693341 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.693775 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] PATH_INFO: `/v3/projects/8bcc14cad23047a9a526e6ced5c5574e/users/1e4ada4e275a4291adbc75c2183a75b9/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.715066 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcc14cad23047a9a526e6ced5c5574e, user_id=1e4ada4e275a4291adbc75c2183a75b9, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.717768 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.732999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1428/2851] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:14 2021] PUT /identity/v3/projects/8bcc14cad23047a9a526e6ced5c5574e/users/1e4ada4e275a4291adbc75c2183a75b9/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:14.747442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.747958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.747958 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.784512 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] MFA Rules not processed for user `1e4ada4e275a4291adbc75c2183a75b9`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:14.785669 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:14.858743 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1424/2852] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:14.864170 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.941778 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3583-e63a-4c4f-867f-cf3a1e8c51d2 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:14.946783 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:14.947374 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:14.947660 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:14.947937 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] PATH_INFO: `/v3/projects` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:14.948604 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:14.950500 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:14.978991 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1429/2853] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:14.983442 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:14.994498 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b32f4-a0cc-4e5a-b202-5913e0abfc4b None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.065655 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.066457 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.066754 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.067037 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] PATH_INFO: `/v3/users` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.067739 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.069679 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.097307 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1425/2854] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:14 2021] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:15.101847 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:15.112275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd51b2-23d1-44ff-aeea-adfa89d237df admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.117536 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.118160 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.118446 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.118707 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.119410 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.121128 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.132315 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1430/2855] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:15.136994 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:15.148154 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ffd07-134b-4485-a84a-1f9ccd901553 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.154594 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.155439 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.155719 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.155992 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] PATH_INFO: `/v3/projects/56149b01e023405d9d3d560f5e282766/users/dab5f86dbf4a4dc0b13cc98f1c16779a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.177183 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56149b01e023405d9d3d560f5e282766, user_id=dab5f86dbf4a4dc0b13cc98f1c16779a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.179974 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.196489 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1426/2856] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:15 2021] PUT /identity/v3/projects/56149b01e023405d9d3d560f5e282766/users/dab5f86dbf4a4dc0b13cc98f1c16779a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:15.200983 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:15.214258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574415c-fcdb-49d7-99b1-1a01802f4bb1 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.282784 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.283395 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.283662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.283947 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.284674 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.286309 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced043-392b-46b9-93b7-10641f5d0087 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.297230 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1431/2857] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:15 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:15.301620 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:15.312020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ccf91-0d36-4939-bc80-89b757eee9e8 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.316801 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.317844 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.318007 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.318187 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] PATH_INFO: `/v3/projects/56149b01e023405d9d3d560f5e282766/users/dab5f86dbf4a4dc0b13cc98f1c16779a/roles/49ff45bcbfb8403790f45aa211a11ca9` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.320101 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56149b01e023405d9d3d560f5e282766, user_id=dab5f86dbf4a4dc0b13cc98f1c16779a, role_id=49ff45bcbfb8403790f45aa211a11ca9)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.322772 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.333289 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1427/2858] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:15 2021] PUT /identity/v3/projects/56149b01e023405d9d3d560f5e282766/users/dab5f86dbf4a4dc0b13cc98f1c16779a/roles/49ff45bcbfb8403790f45aa211a11ca9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:48:15.349208 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.349550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.349859 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.396101 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] MFA Rules not processed for user `dab5f86dbf4a4dc0b13cc98f1c16779a`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:15.397389 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:15.476577 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1432/2859] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:15 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:15.487694 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:15.490902 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:15.573358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ba66-d83e-4911-a983-3b06fd6243e9 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:15.581544 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:15.582149 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:15.582431 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:15.582713 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:15.656128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:15.657749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:15.667909 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1428/2860] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:15 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:17.447762 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:17.449418 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:17.462724 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6b97-1d04-488d-b036-4df3bb3e1f84 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:17.466377 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:17.466960 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:17.467243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:17.467520 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:17.545487 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:17.546955 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:17.556460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1433/2861] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:17 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:18.386584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:18.395302 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e234b2-64f5-4a9e-ac17-1f48eabdf932 service cinder] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:18.399898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:18.400435 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:18.400815 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:18.400916 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:18.414026 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:18.416107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c9f0d-8287-4a24-8706-30d4deb1b68e service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:18.429863 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1429/2862] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:18 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:23.013078 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:23.098324 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57b397-56c2-407b-9eeb-b3546a23d437 service cinder] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:23.102601 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:23.103423 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:23.103710 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:23.103989 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] PATH_INFO: `/v3/users/accbe32c400f412e8f9a765bc19a4b2f` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:23.105137 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accbe32c400f412e8f9a765bc19a4b2f)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:23.107094 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:23.162963 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accbe32c400f412e8f9a765bc19a4b2f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.172654 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accbe32c400f412e8f9a765bc19a4b2f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.185288 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accbe32c400f412e8f9a765bc19a4b2f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.186010 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accbe32c400f412e8f9a765bc19a4b2f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.186712 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accbe32c400f412e8f9a765bc19a4b2f'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.200368 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1434/2863] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:23 2021] DELETE /identity/v3/users/accbe32c400f412e8f9a765bc19a4b2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:23.205166 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:23.205676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:23.205676 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:23.229079 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:23.230234 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:23.299388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1430/2864] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:23.310923 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:23.312726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:23.383292 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b32b7-6e9f-4331-8172-f12917784318 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:23.387036 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:23.388396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:23.388396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:23.388396 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:23.398532 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:23.399980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:23.409519 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1435/2865] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:23.795294 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:23.796749 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:23.809148 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611bf90-bb3d-48f5-ac27-c7adee1b494a None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:23.813388 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:23.814179 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:23.814469 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:23.814744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] PATH_INFO: `/v3/projects/e1c9230cccf24d3fa2ad34025e3737aa` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:23.815831 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c9230cccf24d3fa2ad34025e3737aa)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:23.817885 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:23.870102 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c9230cccf24d3fa2ad34025e3737aa', 'request_id': 'req-40948bf6-b7a2-4779-8b8c-22b91e064d13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.880020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c9230cccf24d3fa2ad34025e3737aa', 'request_id': 'req-40948bf6-b7a2-4779-8b8c-22b91e064d13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.891407 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c9230cccf24d3fa2ad34025e3737aa', 'request_id': 'req-40948bf6-b7a2-4779-8b8c-22b91e064d13'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.902357 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] The token cache is being invalidate because project e1c9230cccf24d3fa2ad34025e3737aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:23.902805 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.903565 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:23.905243 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1431/2866] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:23 2021] DELETE /identity/v3/projects/e1c9230cccf24d3fa2ad34025e3737aa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:23.909432 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:23.919104 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245cb2-3906-42b1-93de-f53fe4ecf6c7 service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:23.988579 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:23.989666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:23.990037 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:23.990266 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] PATH_INFO: `/v3/users/1e4ada4e275a4291adbc75c2183a75b9` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:23.991755 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4ada4e275a4291adbc75c2183a75b9)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:23.993699 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:24.047351 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4ada4e275a4291adbc75c2183a75b9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.055661 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4ada4e275a4291adbc75c2183a75b9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.067651 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4ada4e275a4291adbc75c2183a75b9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.068317 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4ada4e275a4291adbc75c2183a75b9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.069077 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4ada4e275a4291adbc75c2183a75b9'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.081959 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1436/2867] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:23 2021] DELETE /identity/v3/users/1e4ada4e275a4291adbc75c2183a75b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:48:24.477689 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:24.479484 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:24.496358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948bf6-b7a2-4779-8b8c-22b91e064d13 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:24.561279 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:24.562212 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:24.562551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:24.562926 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] PATH_INFO: `/v3/projects/8bcc14cad23047a9a526e6ced5c5574e` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:24.564132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcc14cad23047a9a526e6ced5c5574e)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:24.566193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:24.620193 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcc14cad23047a9a526e6ced5c5574e', 'request_id': 'req-9c57d8a1-a8a1-4059-b724-473151362097'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.629132 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcc14cad23047a9a526e6ced5c5574e', 'request_id': 'req-9c57d8a1-a8a1-4059-b724-473151362097'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.641032 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcc14cad23047a9a526e6ced5c5574e', 'request_id': 'req-9c57d8a1-a8a1-4059-b724-473151362097'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.651283 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] The token cache is being invalidate because project 8bcc14cad23047a9a526e6ced5c5574e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:24.651574 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.652368 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.653966 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1432/2868] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:24 2021] DELETE /identity/v3/projects/8bcc14cad23047a9a526e6ced5c5574e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:24.658258 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:24.659723 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:24.672939 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a34ab-148b-4068-ae19-a49a115849bf admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:24.743133 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:24.743942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:24.744224 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:24.744539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] PATH_INFO: `/v3/users/dab5f86dbf4a4dc0b13cc98f1c16779a` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:24.745731 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab5f86dbf4a4dc0b13cc98f1c16779a)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:24.747703 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:24.804999 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab5f86dbf4a4dc0b13cc98f1c16779a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.813383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab5f86dbf4a4dc0b13cc98f1c16779a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.825850 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab5f86dbf4a4dc0b13cc98f1c16779a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.826557 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab5f86dbf4a4dc0b13cc98f1c16779a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.827243 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-9786efff-c7de-4722-82d0-a22c7703c0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab5f86dbf4a4dc0b13cc98f1c16779a'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:24.841662 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1437/2869] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:24 2021] DELETE /identity/v3/users/dab5f86dbf4a4dc0b13cc98f1c16779a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:25.213067 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.214551 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:25.227223 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d8a1-a8a1-4059-b724-473151362097 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.293314 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.294109 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.294391 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.294659 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] PATH_INFO: `/v3/projects/56149b01e023405d9d3d560f5e282766` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.295780 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56149b01e023405d9d3d560f5e282766)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.297730 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.350709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56149b01e023405d9d3d560f5e282766', 'request_id': 'req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:25.358747 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56149b01e023405d9d3d560f5e282766', 'request_id': 'req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:25.371332 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56149b01e023405d9d3d560f5e282766', 'request_id': 'req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:25.381584 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] The token cache is being invalidate because project 56149b01e023405d9d3d560f5e282766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:25.381869 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:25.382709 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-ffdb59ab-fadb-4ce1-ab70-ac1d582b273b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:25.384211 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1433/2870] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:25 2021] DELETE /identity/v3/projects/56149b01e023405d9d3d560f5e282766 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 13:48:25.390216 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.390702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.390802 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.414111 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:25.415286 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:25.483832 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1438/2871] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 13:48:25.496811 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.497673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.497673 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.525107 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:25.526258 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:25.535260 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1434/2872] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:25.539946 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.554980 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dd992-af2c-4cb3-a84c-15e423d311c6 None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.560666 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.561275 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.561533 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.561808 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.562574 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 13:48:25.562875 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.564556 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.578026 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1439/2873] 10.222.0.60 () {58 vars in 1152 bytes} [Tue Nov 23 13:48:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 13:48:25.582716 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.592572 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7830f-ba6c-4bea-815f-d611158835d7 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.598071 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.598653 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.598940 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.599218 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.599862 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.601861 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.636898 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1435/2874] 10.222.0.60 () {60 vars in 1152 bytes} [Tue Nov 23 13:48:25 2021] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 13:48:25.642460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.652787 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261d5b-9cfa-4353-911a-d9d087084a0a admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.725550 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.726166 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.726452 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.726732 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] PATH_INFO: `/v3/users` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.727383 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.729347 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.751965 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1440/2875] 10.222.0.60 () {60 vars in 1143 bytes} [Tue Nov 23 13:48:25 2021] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 13:48:25.756798 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.766950 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190aff7-9b45-442b-a082-4ac5f70a5a9b admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.771393 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.772034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.772338 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.772622 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] PATH_INFO: `/v3/roles` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.773358 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.774941 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.785128 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1436/2876] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 13:48:25.789460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.799256 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5743da-f838-42c6-8d1a-04e6f4ee11d5 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.804343 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.804942 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.805260 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.805539 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] PATH_INFO: `/v3/roles` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.806229 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.807827 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f600b-066f-4259-a051-c3f5b68da51c admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.818417 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1441/2877] 10.222.0.60 () {58 vars in 1121 bytes} [Tue Nov 23 13:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 13:48:25.823089 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:25.833813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63fc4-e115-4c4b-a88b-4cbacb353963 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:25.838656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:25.839463 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.839744 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.840020 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] PATH_INFO: `/v3/projects/8c8332cc28324bbe8275ca86d1ab3864/users/07bfd4628ad644a5a1a1dc135f84b1d8/roles/45348a9ac36945cc8b1051e879a0eaa7` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.859635 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8332cc28324bbe8275ca86d1ab3864, user_id=07bfd4628ad644a5a1a1dc135f84b1d8, role_id=45348a9ac36945cc8b1051e879a0eaa7)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:25.862335 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:25.877098 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1437/2878] 10.222.0.60 () {60 vars in 1482 bytes} [Tue Nov 23 13:48:25 2021] PUT /identity/v3/projects/8c8332cc28324bbe8275ca86d1ab3864/users/07bfd4628ad644a5a1a1dc135f84b1d8/roles/45348a9ac36945cc8b1051e879a0eaa7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:25.887726 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4797-2956-422f-96be-0978115650bc None None] REQUEST_METHOD: `POST` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:25.887952 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4797-2956-422f-96be-0978115650bc None None] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:25.888253 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4797-2956-422f-96be-0978115650bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:25.925460 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.auth.core [None req-238a4797-2956-422f-96be-0978115650bc None None] MFA Rules not processed for user `07bfd4628ad644a5a1a1dc135f84b1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=66603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:25.926594 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-238a4797-2956-422f-96be-0978115650bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:26.009518 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1442/2879] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:25 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:26.023671 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:26.026513 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:26.102002 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da382f2-71eb-4542-846d-d564e238fbb3 admin admin] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:26.105656 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f54266b73f542309722b317e80e5f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:26.106230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] REQUEST_METHOD: `GET` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:26.106516 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:26.106793 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:26.115447 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:26.117230 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe73d3-2f13-4a16-8d6f-4a7d71a03c50 service cinder] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:26.126450 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1438/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:26 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:35.900265 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4797-2956-422f-96be-0978115650bc None None] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:35.979073 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4797-2956-422f-96be-0978115650bc None None] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:35.984319 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:35.985148 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:35.985428 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:35.985702 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] PATH_INFO: `/v3/users/07bfd4628ad644a5a1a1dc135f84b1d8` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:35.986928 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bfd4628ad644a5a1a1dc135f84b1d8)` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:35.988883 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:36.046597 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bfd4628ad644a5a1a1dc135f84b1d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.056407 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bfd4628ad644a5a1a1dc135f84b1d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.068998 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bfd4628ad644a5a1a1dc135f84b1d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.069682 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bfd4628ad644a5a1a1dc135f84b1d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.070345 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.notifications [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bfd4628ad644a5a1a1dc135f84b1d8'} {{(pid=66603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.085080 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1443/2881] 10.222.0.60 () {58 vars in 1223 bytes} [Tue Nov 23 13:48:35 2021] DELETE /identity/v3/users/07bfd4628ad644a5a1a1dc135f84b1d8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:48:36.090022 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] REQUEST_METHOD: `POST` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:36.090539 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:36.090813 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:36.114897 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.auth.core [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] MFA Rules not processed for user `3fde6f358f0c4f9d97186836d44cc1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 13:48:36.116160 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:36.193203 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1439/2882] 10.222.0.60 () {58 vars in 957 bytes} [Tue Nov 23 13:48:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 13:48:36.207188 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:36.209656 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:36.277503 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278ddcb-b878-4929-97bb-52ce67c56391 admin admin] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:36.281402 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '326b9ed23f5a43d6bb57a386c688c873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:36.281990 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:36.282276 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:36.282552 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:36.292621 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:36.294057 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:36.304047 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1444/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:48:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 13:48:36.804726 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] Authenticating user token {{(pid=66604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:48:36.806300 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.fernet_utils [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:48:36.818816 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f57cd0-b3b5-4878-a0c1-8f1597759cb9 None None] Validating token access rules against request {{(pid=66604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:48:36.825329 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fde6f358f0c4f9d97186836d44cc1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8d73aaed4704c2faee627a52d37a0f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:48:36.826268 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:48:36.826647 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:48:36.827050 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] PATH_INFO: `/v3/projects/8c8332cc28324bbe8275ca86d1ab3864` {{(pid=66604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:48:36.828394 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8332cc28324bbe8275ca86d1ab3864)` {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:48:36.830416 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] RBAC: Authorization granted {{(pid=66604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:48:36.889688 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8332cc28324bbe8275ca86d1ab3864', 'request_id': 'req-53d19dd6-aa4f-456d-ad28-d4858989f9d8'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.899034 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8332cc28324bbe8275ca86d1ab3864', 'request_id': 'req-53d19dd6-aa4f-456d-ad28-d4858989f9d8'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.914770 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8332cc28324bbe8275ca86d1ab3864', 'request_id': 'req-53d19dd6-aa4f-456d-ad28-d4858989f9d8'} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.929684 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] The token cache is being invalidate because project 8c8332cc28324bbe8275ca86d1ab3864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 13:48:36.930005 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.930936 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: DEBUG keystone.notifications [None req-53d19dd6-aa4f-456d-ad28-d4858989f9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 13:48:36.932603 dv-cinder-818886-1-iscsi devstack@keystone.service[66604]: [pid: 66604|app: 0|req: 1440/2884] 10.222.0.60 () {58 vars in 1232 bytes} [Tue Nov 23 13:48:36 2021] DELETE /identity/v3/projects/8c8332cc28324bbe8275ca86d1ab3864 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 13:53:04.741203 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] Authenticating user token {{(pid=66603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 13:53:04.742833 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:53:04.873892 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b34e-d8b8-472a-a6cc-3c62c97e124f service neutron] Validating token access rules against request {{(pid=66603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 13:53:04.947191 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '330a0223f48d4b03bc84c07e34ec62a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60daf20d62b04791a1ef39231d6b25d1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 13:53:04.947800 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] REQUEST_METHOD: `GET` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 13:53:04.948076 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] SCRIPT_NAME: `/identity` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 13:53:04.948380 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 13:53:04.950474 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.fernet_utils [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 13:53:04.963114 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 13:53:04.964910 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f7205-964a-45dd-8330-161d03329414 service placement] RBAC: Authorization granted {{(pid=66603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 13:53:04.974589 dv-cinder-818886-1-iscsi devstack@keystone.service[66603]: [pid: 66603|app: 0|req: 1445/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Nov 23 13:53:04 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)